% % 



Appendix A 

Appendix A illustrates semantic types that may be supported and their corresponding 
adaptive template names. For example, the Pipelined semantic type is made up of, in this order, 
the mapjceys the pipe_state and the index_fact adaptive templates. The example pre-parsed and 
post parsed SQL adaptive templates are then provided. 

As mentioned previously, the use of the semantic types significantly reduces the amount of 
work needed to implement the datamart 150. By selecting a semantic type for a particular fact 
table or dimension table, the consultant automatically selects the corresponding pre-parsed SQL 
adaptive templates. The selected adaptive templates are then automatically converted into post 
parsed SQL statements that include the schema specific information for the datamart 1 50. 



Additionally, these post parsed SQL statements include the SQL for accessing and manipulating 
the datamart 150 tables. 



Pipelined 



map_keys 



Pipelined 



pipe_state 



Pipelined 



Pipelined/Unjoined 



index fact 



upd_unj 



Pipelined/Unjoined 



mapjceys 



Pipelined/Unjoined 



pipe_state 



Pipelined/Unjoined 



index fact 



Slowly Changing Dimensions 



insert dim 



Slowly Changing Dimensions 



index dim 



Transactional 



map_keys 



Transactional 



load trans 



Transactional 



Transactional 



ren trans 



index fact 



Transactional/lnventory 



map_keys 
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% % 





Tra rmactiona l/l n ventorv 

i i 01 ioa wliui lair 1 1 1 v ci i iwi y 


load trans 




Tran^artinnal/lnvpntorv 

1 1 Ol lOavllwl lOl/ 1 1 1 Vd HVl y 


inv adjust 




Tran^actional/lnvpntorv 


index fact 




Transactional/lnventory/ForceZero 


map_keys 




"Troncaf*tinnal/l n\/onf^r\//Frtrr*o7prn 
1 1 oi loauuui loi/ii ivci uui y/rui v/C£.ci u 


load trans 

IwQU 11 01 Iw 




Transactional/lnventory/ForceZero 


force_zero 




i ransactionai/inveniory/rorcez.ero 


inv/ sHiiict 
IHV_oU|UoL 




Transactional/lnventory/ForceZero 


index_fact 




Transactional/lnventory/ForceZero/Unjoined 


upo_unj 




Transactional/1 nventory/ForceZero/Unjoined 


rnap_Keys 




Transactional/1 nventory/ForceZero/Unjoined 


load_trans 




Transactional/lnventory/ForceZero/Unjoined 


force_zero 

- -» » — 




Transactional/lnventory/ForceZero/Unjoined 


inv_adjust 




Transactionai/inventory/horcezero/unjoinea 


inrlfiv foot 

inuex_Taci 




i ransacuonai/inveniory/unjoiricu 


imri iini 


s 


i ransaciiunai/invenxory/unjoincu 


man kpv/c 


3-T1: 


i ransaciionai/i n veniory/ u njuii icu 


Inari tran^ 

IUaU 11 Cll 19 


: J ; 


I ransaciionai/inveniory/unjuiiicu 


inv aHhiQt 




i ransacuonai/inveniury/unjUM icu 


inHpv faf*t 




i ransoCiionai/oiaicii(\c 


man kp\/Q 


o 

'""4 


i ransaciionai/oiaieiiKc 


InaH tranc 
iuciu u ai ia 


i ronsacuonai/oiaieiiRc 


InaH statp 

IU0VJ O L0 IC 




I ransacuonai/oiaieiiKc 


inripy far*t 

II IUCA 10V/ 1 




Transactional/Statelike/ForceClose 


map_keys 




i ransactionai/oiaiciiKe/rorceoioae 


lUdvj li alia 




Transactional/Statelike/ForceClose 


force_close 




Transactional/otateiiKe/rorceoiose 


ioau_sxare 




Transactional/Statelike/ForceClose 


index_fact 




Transactional/Statelike/ForceClose/Unjoined 


upd_unj 




Transactional/Statelike/ForceClose/Unjoined 


map^keys 




Transactional/otatelike/rorceuiose/unjoinea 


ioao_irans 




Transactional/Statelike/ForceClose/Unjoined 


force_close 




Transactional/Statelike/ForceClose/Unjoined 


load_state 
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Tronear»tir»nal/Qfatelik'p/Pnrrpninse/Unioined 

1 r3nS3CllUFlal/Olcllclll\c/rui Lcuiyoc/ui ijuii icu 


index fact 


Tronear*tinnal/^tatplikp/l Jnioined 
1 r3nSoCllUi lal/OlalclINC/ \Ji ijuii igvj 


UDd uni 


Xroneo/^tirkncil/Qtatoliko/l InintnpH 

l r3ns9cuunai/oidiciii\c/uiijuH icu 


map_keys 


I r3ns3ciionai/oidieii^/ wmjuii icu 


load_trans 


Xr-^r»c"5r»fi<^nol/QtatoliU r o/l InininpH 

I rsnsBCiionai/oiaieiiNc/uiijuiMcu 


load state 


Transactional/Statelike/Unjoined 


index fact 


Transactional/Unjoined 


updjjnj 


Transactional/Unjoined 


map_keys 


Transactional/U njoined 


load trans 


Transactional/Unjoined 


ren trans 


Transactional/Unjoined 


index fact 



The following are the pre-parsed pseudo-SQL source for the adaptive templates. 



111 



• : 



:ssr 



— #TEMPLATE_BEGIN# force_close 
/**********************************************>*********************** 

Copyright * 1997, Epipfian^M^l^ing-Software, Inez — Brri-Ri-gh1:s"Reserved^ 

— force_close 

— Close out deleted orders - those that no longer appear in the 

— staging table 

— SEE SAFETY VALVE BELOW 

/************************************************'***************** 

/***** *****************************************************************************/ 
/*********** 



Delete te^orary^tables^^^^ ***********************************************/ 



— #BLOCK — BEGIN# DropTemps 
$$DDL_BEGIN 

$ $ DROPJFABLE_I F_EXI STS [ $ $ FCTT BL t ] _FC ] 
$$DDL_END 

— # BL0CK_EN D# DropTemps 

/*******************************"^ 

— Insert negative BOOKs for deleted orders 

_ vc * ForceClose 

,****;***********************^^ 

— #BLOCK_BEGIN# MakeFC 

$ $ SELECT_INTO_BEG IN [ $ $ FCTTBL [ ] _FC ] 
SELECT 

f.iss, 
f.ssjcey, 

MAX ( f . date_key ) date_key, 
MIN ( f . transtype key) transtype key, _ 
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MAX(f.seq) + 1 seq 
f ,$$DIMKEYR_01 
f .$$DIMKEYR_02 
f .$$DIMKEYRJ)3 
f .$$DIMKEYR_04 
f .$$DIMKEYR_05 
f .$$DIMKEYR_06 
f .$$DIMKEYR_07 
f .$$DIMKEYR_08 
f ,$$DIMKEYR_09 
f .$$DIMKEYR_10 
f . $ $ DEGKEY_0 1 
f . $$DEGKEY_02 
f . $ $ DEGKE Y_0 3 

-SUM(f .$$FCTCOL_001) $$FCTCOL_001 
-SUM(f .$$FCTCOL_002) $$FCTCOL_002 
-SUM(f .$$FCTCOL_003) $$FCTCOL_003 
- SUM ( f . $ $ FCTCOL _00 4 ) $ $ FCTCOL_00 4 
-SUM(f .$$FCTCOL_005) $$FCTCOL_005 
- SUM < f . $ $ FCTCOL_0 06) $ $ FCTCOL_0 0 6 
-SUM(f .$$FCTCOL_007) $$FCTCOL_007 
-SUM(f .$$FCTCOL_008) $$FCTCOL_008 
-SUM(f .$$FCTCOL_009) $$FCTCOL_009 
-SUM(f .$$FCTCOL_010) $$FCTCOL_010 
-SUM(f .$$FCTCOL_011) $$FCTCOL_011 
-SUM(f .$$FCTCOL_012) $$FCTC0LJ)12 
-SUM{f .$$FCTC0L_013) $$FCTCOL_013 
-SUM(f .$$FCTCOL_014) $$FCTCOL_014 
-SUM(f .$$FCTCOL_015) $$FCTCOL_015 
-SUM(f .$$FCTCOL_016) $$FCTCOL_016 
-SUM(f .$$FCTCOL_017) $$FCTCOL_017. 
-SUM(f ,$$FCTCOL_018) $$FCTC0LJ)18 
-SUM(f .$$FCTCOL_019) $$FCTCOL_019 

T ^SUM(f...$$^TCQLja2JJ_$^F^CAI w 02_0. 

-SUM(f .$$FCTCOL_021) $$FCTCOL_021 
-SUM{f .$$FCTCOL_022) $$FCTC0LJ)22 
-SUM(f .$$FCTCOL_023) $$FCTC0L_023 
-SUM(f .$$FCTCOL_024) $$FCTC0L_024 

$$SELECT_INTO_BODY [$$FCTTBL[]_FC] 
FROM 



(SELECT 1 FROM $$FSTGTBL[ ] _MAP s WHERE s.iss - f.iss AND s.ssjcey « f.ss_key) 
GROUP BY 

f.iss, 
f . ss_key 
f ,$$DIMKEYR_01 
f .$$DIMKEYR_02 
f .$$DIMKEYR_03 
, f .$$DIMKEYR_04 

f .$$DIMKEYR_05 
f ,$$DIMKEYR_06 
f .$$DIMKEYR_07 
, f . $$DIMKEYR_08 

f .$$DIMKEYR_09 
, f .$$DIMKEYR_10 

f . $$ DEGKE Y_01 
, f ,$$DEGKEYJ)2 

f . $$DEGKEY_03 

HAVING 

( 

(SUM(f .$$FCTCOL_001) <> 0) 
OR <SUM(f .$$FCTCOL_002) <> 0) 
OR (SUM{f .$$FCTCOL_003) <> 0) 
OR (SUM(f .$$FCTCOL_004) <> 0) 
OR (SUM(f .$$FCTCOL_005) <> 0) 

OR (SUM(f .$$FCTCOL 006) <> 0) 



$$FCTTBL[]$$CURR f 



WHERE 



NOT EXISTS 
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Q 



Us 

iij 



OR 


(SUM ( f 


. 9 9 r 1 1_UJj 


nm \ 
UU / / 


<> 




OR 


(SUM(f 


. 9?tLl L-UJj 


UUo ; 




u J 


OR 


( SUM ( f 


. sW t 1 l-UJu 


"nno \ 




n * 


OR 


(SUM( f 


, 9 p r L- 1 L-UJj 


~ni n \ 
uiu j 




n i 
u J 


OR 


(SUM(f 


. p p r L. i L.U1> 


UJL 1 / 




n t 
u / 


OR 


( SUM ( f 


ft ft Trr* r pp , /^T 


"ni 9 \ 




n i 


OR 


(SUM (f 


ft ft it^t/t^t 


"m "j\ 
Ul J ; 


<> 


n \ 
u ; 


OR 


(SUM(f 


ft ft Tr/~"Pf/"\T 
. 9 9 r L. i L-UJj__ 


~m a \ 
Ul* J 






OR 


(SUM(f 


ft ft rf""T , /"* , f\T 


"ftl c \ 

U1D J 






OR 


(SUM(f 


.$$FCTCOL~ 


"016) 


<> 


0) 


OR 


(SUM(f 


,$$FCTCOL~ 


J)17) 


<> 


0) 


OR 


(SUM (f 


. $5FCTCOL_ 


U±D J 




U J 


OR 


( SUM ( f 


c ft v?r"rrT\T ~ 


"m q» 




yj i 


OR 


(SUM (f 


. $SFCTCOL_ 


VZv ) 


o 


u ) 


OR 


(SUM (f 


ft ft FCTCOlf 


021 ) 


<> 


0) 


OR 


(SUM(f 


.$$fctcol" 


"022 ) 


<> 


0) 


OR 


(SUM{f 


.$$fctcol" 


"023) 


<> 


0) 


OR 


(SUM(f 


. $$ FCTCOlf 


'024) 


<> 


0) 


AND 


) 












MIN (f . 


trans type_ 


key) 


<«= 


99 


AND 














MIN (f . 


transtype_ 


_key) 


>= 


1 



— #BL0CK_END# MakeFC 

/***********************+★** **********************^ 
— SAFETY VALVE - THIS PROC ONLY DOES ANYTHING 
—IF THE STAGING TABLE HAS AT LEAST ONE ROW 
/*****************************************^ 

— #BLOCK_BEGIN# SafetyValue 

DECLARE $$VAR [count MAP) $$EPIINT$$EOS 



3 si 



BEGIN 

$$VAR_ASSIGN_BEGIN[count_MAP] 
SELECT COUNT (1) 
$$VAR_ASSIGN_INTO [ count_MAP J 
FROM $ $ FSTGTBL [ ) _MAP 
$$VAR_ASSIGN_END 

S$IF[ ($$VAR[count_MAP] « 0)] 
DELETE FROM $$FCTTBL [ ]_FC$$E0S 
$$END_IF 

END$$E0S 

— #BLOCK_END# SafetyValue 

/********************************************************** 
— Count processed, inserted rows 

/***************** ★***★******************★***********************+*****************/ 

--#BLOCK_BEGIN# SPResults 

BEGIN 

INSERT INTO adaptive_template_prof ile (token_name, number_rows) 
SELECT ' PROCESSED 1 , COUNT (1) FROM $$FCTTBL[ ] $$CURR$$E0S 

INSERT INTO adaptive_template_prof ile (token_name, number_rows) 
SELECT 'INSERTED*, COUNT (1) FROM $$FCTTBL [ 3 _FC$$E0S 

END$$E0S 

~#BLOCK_END# SPResults 

— # TEMPLATE END# force close 
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-#TEMPLATE_BEGIN# load_state 
/*^**+********** ***************************************************************** 

- Copyright * 1997, Epiphany Marketing Software, Inc. All Rights Reserved. 

— load_state 

— Load order bookings into fact table by creating transactional 

— data from state data 

- load_trans must be run before this procedure to create TIN table 

***********************************************************************************/ 
***************************************************************************** ******/ 

Z****^**^*^ 
-#BLOCK_BEGIN# DropTemps 

$$DDL_BEGIN 

$$DROP_TABLE_IF_EXISTS [ $$FCTTBL [ ]_MFL] 
$$DROP TABLE_IF_EXISTS[$$FCTTBL[]_1ST] 
$$DROP~TABLE_IF_EXISTS [ $$FCTTBL [ ]_IL] 
$$DR0P_TABLE_IF EXISTS [ $$FCTTBL [ ]_IR] 
$ $ DROP_TABLE_I F~EXI STS [ $ $ FCTTBL [ ] _I RD] 
$ $ DROP_TABLE_I F_EXI STS [ $ $ FCTTBL t ] _IND] 
$$DROP TABLE_IF_EXISTS [ $$ FCTTBL [ ]_NFD] 
$$DROP~TABLE_IF_EXISTS [ $$ FCTTBL [ ]_IRM] 
$ $ DROP_TABLE_I F_EXI STS [$$ FCTTBL ( ] _I DM] 
$$DROP TABLE_IF_EXISTS[$$FCTTBL[]_ILM] 
$$DROP~TABLE_IF_EXISTS [$$ FCTTBL [ ] _IMI] 
$$DDL END 



— #BLOCK_END# DropTemps 

******************** 
Set join order for SQL Server 



/******************************************************************/ 



/******************************************************************/ 
— #BLOCK_BEGIN# ForcePlanOn 
$$ SQLSERVER [ SET FORCEPLAN ON] 
— #BLOCK_END# ForcePlanOn 

/******************************************************************************** 

— Remove rows older than fact table - history can not be rewritten - only 
—the last date for an order can be changed. Note that we compare transtype s 

— because SHIP type transactions might occur at a later date and we don't want 
those to interfere 

Also, since the staging table may have multiple entries for a given order on 

— a single day - we assume that the list one inserted in the Staging table will 

— be used (since ikey is an IDENTITY column) 

— Note that a given ss_key must use the same Booking transtype for all of time, 

— otherwise the transtype_key 

;;****;**^ 

— #BLOCK_BEGIN# MakeMFL 

$$SELECT_INTO_BEGIN [$$FCTTBL [ ] _MFL] 
SELECT 

S.* 

$ $SELECT_INTO_BODY [ $ $ FCTTBL [ ] _MFL ] 

FROM . — 
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WHERE 



AND 



AND 



$ $ FSTGTBL [ ] _MAP s, bus_process b 

((s.date_key >= (SELECT MAX (date_key) FROM $$FCTTBL[ ] $$CURR f WHERE 

s.iss = f.iss AND s.ssjcey = f .ssjtey AND 

s. transtype_key = f . transtype_key) ) 
OR NOT EXISTS (SELECT * FROM $$FCTTBL[ ] $$CURR f WHERE 

s.iss = f.iss AND s.ss_key = f.ss_key AND 

s. trans type_key = f . transtype_key) ) 
s.ikey = (SELECT MAX(t.ikey) FROM $ $ FSTGTBL [ ] _MAP t WHERE 

s.iss ~ t.iss AND 

s.ss_key *= t.ss_key AND 

s.date_key = t.date_key AND 

t .process_key = b. process_key) 



s .process_key = b . process_key AND b ,process_name = 'LoadState' 
-#BLOCK_END# MakeMFL 

— Index MFL table for later queries 
***********************************************************************************/ 

--#BLOCK_BEGIN# IndexMFL 

$$DDL_BEGIN 
$$DDL_EXEC[ 

CREATE INDEX X$$FCTTBL [ ]_MFL ON $ $ FCTTBL [ ] _MFL 
( 

iss, ss_key, date_key 

) 
] 

$$DDL_END 

— # BLOCK_END# IndexMFL 

/********★******★***★***************************************************************/ 

— Get oldest state rows for each unique sskey 

__ we need to treat the first entry for each order 

— in the staging table separately from all others, since 
only the first entry needs to be compared with 

~ already existing fact entry rows to create transactions. 

— All subsequent dates for that order in the Fact table 

— can be delta' d with other staging table entries - see the 

— section below on Pairwise deltas. 

— MFL should be indexed 

— 1ST: The first record for each iss, ss_key 

/***********************************************************************************/ 
— #BLOCK_BEGIN# MakelST 

$ $ SELECT_INTO_BEGIN [ $ $ FCTTBL [ ] _1 ST ] 
SELECT 

s.* 

$ $ SELECT_INTO_BODY [ $ $ FCTTBL [ ] _1ST] 
FROM 

$ $ FCTTBL [ ] _MFL s 

WHERE 

S.datejcey = (SELECT MIN (date_key) FROM $ $ FCTTBL [ ] _MFL t WHERE 
s.iss = t.iss AND s.ss_key = t.ss_key) 

— ft BLOCK_END# MakelST 

/*********+*************************************************************************/ 

— Index 1ST for later queries 

/********************+**************************************************************/ 
--#BLOCK BEGIN# IndexlST 



Method and Apparatus for Creating a Well- PATENT Inventors: Craig D. Weissman, 

Formed Database System Using a Computer Page 105 Greg V. Walsh and Eliot L. Wegbreit 

Attorney Docket No. 20308.710 
C:\NRPORTBL\PALibl\acw\l058393. 1 



$$DDL_BEGIN 
$$DDL_EXEC[ 

CREATE UNIQUE INDEX XPK$$FCTTBL [ ] _1ST ON $$FCTTBL [ ) _1ST 
( 

iss, ss_key 

) 
] 

$ $ DDL_END 

— #BLOCK_END# IndexlST 

/★★★it************************************************* 
-- Insert negative BOOKs for changed dim keys 

— This query will add up all existing Books and Loss's 
for this order and the net facts will be cancelled out 

-- with the old Dimension keys. Note that an invariant of this 

— procedure is that only one set of dimensions at a time 

— can have non-zero facts. 

— Fact table Should be indexed 

— HAVING Clause is needed to prevent changing of dimensions 

on fully shipped order from causing a transaction - no sense 

— creating fact rows with all zero's in them 

— Note that we increment the sequence number just in case 

— this new transaction occurs on the same date as the last 

— existing one in the fact table - to avoid index errors 



— IL: InsertLost 



— #BLOCK_BEGIN# MakelL 

$$SELECT_INTO_BEGIN [ $$FCTTBL [ ]_IL) 
SELECT 

s. iss, 
s.ss_key, 
s.date_key, 
s . transtype_key , 
MAX(f.seq) + 1 seq 
f ,$$DIMKEYR_01 
f ,$$DIMKEYR_02 
f ,$$DIMKEYR_03 
f . $$DIMKEYR_04 
f .$$DIMKEYR_05 
f .$$DIMKEYR_06 
f .$$DIMKEYR_07 
f .$$DIMKEYR_08 
f . $$DIMKEYR_09 
f ,$$DIMKEYR_10 
f . $ $ DEGKEY_0 1 
f ,$$DEGKEY_02 
f.$$DEGKEY 03 



-SUM(f . 
-SUM{f . 
-SUMtf. 
-SUM(f . 
-SUM(f . 
-SUMtf. 
-SUM(f . 
-SUM(f . 
-SUM(f . 
-SUMtf. 
-SUMtf . 
-SUM(f . 
-SUM(f. 
-SUMtf. 
-SUM(f. 



$$FCTCOL 
$$FCTC0L~ 
$$FCTCOL* 

$$fctcol" 
$$fctcol~ 
$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol' 
$$fctcol' 
$$fctcol" 
$$fctcol" 
$$fctcol" 

$$FCTCOL 



001) 
"002) 
'003) 
'004) 
"005) 
"006) 
"007) 
'008) 
"009) 
"010) 
"011) 
"012) 
"013) 
"014) 
"015) 



$$FCTCOL_001 
$$FCTCOL_002 
$$FCTCOL_003 
$$FCTCOL_004 
$$FCTCOL_005 
$$FCTCOL_006 
$$FCTCOL_007 
$$FCTCOL_008 
$$FCTCOL_009 
$$FCTCOLJ)10 
$$FCTCOL_011 
$$FCTCOL_012 
$$FCTCOL_013 
$$FCTCOL_014 
$$FCTCOL 015 
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-SUM(f . 
-SUM(f . 
-SUM(f . 
-SUM(f . 
-SUM(f . 
-SUM(f . 
-SUM(f . 
-SUM(f . 
-SUM(f . 



$$FCTCOL 
$$FCTC0L 
$$FCTCOL" 
$$FCTC0L 
$$FCTCOL 
$$FCTCOL 
$$FCTC0L 
$$FCTCOL 

$$fctcol" 



016) 
"017) 
"018) 
"019) 
"020) 
'021) 
'022) 
"023) 
*024) 



$SFCTCOL_016 
$$FCTCOL_017 
$$FCTCOL_018 
$$FCTCOL_019 
$$FCTCOL_020 
$$FCTCOL_021 
$$FCTCOL_022 
$$FCTCOL_023 
$$FCTCOL 024 



$ $ SELECT_INTO_BODY [ $ $ FCTTBL [ ] _I L ] 
FROM 

$$FCTTBL[)_1ST s, $$FCTTBL [ ] $$CURR f 

WHERE 

s.iss = f.iss AND s.ss_key «= f.ss_key 

AND 

( (S.$$DIMKEYR_06 <> f . $$DIMKEYR_06) OR 
(S.$$DIMKEYR_05 <> f.$$DIMKEYR 05) OR 
(s.$$DIMKEYR_07 <> f . $$DIMKEYR_07) OR 
<S.$$DIMKEYR_04 <> f . $$DIMKEYR_04 ) OR 
(S.$$DIMKEYR_08 <> f . $$DIMKEYR_08 ) OR 
(S.$$DIMKEYR_03 <> f . $$DIMKEYR_03) OR 
(S.$$DIMKEYR_09- <> f . $$DIMKEYR_09) OR 
(s.$$DIMKEYR_02 <> f . $$DIMKEYR_02 ) OR 
(s.$$DIMKEYR_10 <> f . $$DIMKEYR_10) OR 
(S.$$DIMKEYR_01 <> f . $$DIMKEYR_01 ) ) 

GROUP BY 

s.iss, 

s . ss_key, 

s . date_key, 

s . transtype_ key 

f ,$$DIMKEYR_01 
, f .$$DIMKEYR_02 

, f .$$DIMKEYR_03 

f .$$DIMKEYR_04 

f ,$$DIMKEYR_05 
, f .$$DIMKEYR_06 

f ,$$DIMKEYR_07 

f ,$$DIMKEYR_08 

f ,$$DIMKEYR_09 
, f .$$DIMKEYR_10 

, f . $$DEGKEY_01 

, f . $$DEGKEY_02 

f . $$DEGKEY_03 

HAVING 

MIN (f . trans type_key) = s . transtype_key 

AND 



( 





(SUM(f . 


$$FCTC0L 


001) 


<> 


0 


OR 


(SUM(f .$$FCTCOL 
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<> 


0 


OR 


(SUM(f 


$$FCTCOL 


003) 


<> 
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OR 


(SUM(f 
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<> 


0 


OR 


(SUM(f 


$$FCTCOL~ 


"005) 


<> 


0 


OR 


(SUM(f 


$$FCTCOL*" 


"006) 


<> 


0 


OR 


(SUM(f 


$$fctcol" 


"007) 


<> 


0 


OR 


(SUM(f 


$$fctcol" 


"008) 


<> 


0 


OR 


(SUM(f 


$$fctcol" 


"009) 


<> 


0 


OR 


(SUM(f 


$$FCTCOL~ 


"010) 


<> 


0 


OR 


(SUM{f 


$$fctcol" 


"Oil) 


<> 


0 


OR 


(SUM(f 


$$fctcol" 


'012) 


<> 


0 


OR 


(SUM{f 


$$fctcol" 


"013) 


<> 


0 


OR 


(SUM(f 


$$fctcol" 


"014) 


<> 


0 


OR 


(SUM(f 


$$fctcol" 


"015 ) 


<> 


0 


OR 


(SUM(f 


$$fctcol" 


"016) 


<> 


0 


OR 


(SUM(f 


.$$fctcol" 


"017) 


<> 


0 


OR 


(SUM(f 


.$$fctcol" 


~018) 


<> 


0 


OR 


(SUM(f 


.$$fctcol" 


"019) 


<> 


0 


OR 


(SUM{f 


.$$fctcol" 


"020) 


<> 


0 


OR 


(SUMtf 


,$$fctcol" 


021) 


<> 


0 


OR 


{SUM(f 


.$$fctcol" 


"022) 


<> 


0 
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OR (SUM(f .$$FCTCOL_023) <> 0) 

OR (SUM(f .$$FCTGOL_024) <> 0) 

) 

- - # BLOCK_END# MakelL 

/**************************************************************************** 

— Index IL for later queries 

^******************** *'**************************************************************/ 
— #BLOCK_BEGIN# IndexIL 

$$DDL_BEGIN 
$$DDL_EXEC [ 

CREATE INDEX XPK$$FCTTBL [ ] _IL ON $$FCTTBL [ ] _IL 
( 

iss, ssjcey 

) 
] 

$$DDL_END 

— #BLOCK_END# IndexIL 

/★★★★♦it*****************************************************************************/ 

— Insert BOOKs for changed dim keys 

— When a dimension changes then just create a booking 

— transaction for whatever we negated above with the new 

— dimension and fact values 

~ 1ST shoud be indexed 

— Note that we add one to whatever we used as the last 

— seq because this transaction occurs on the same 

— date as the negative one above 

— IR: Insert Rebook 

y************************************************************ ***********************/ 

— #BLOCK_BEGIN# MakeIR 

$ $SELECT_INTO_BEGIN [ $$FCTTBL [ ] _IR] 
SELECT 

s. iss, 
s.ss_key, 
s.date_key, 
1 . transtype_key , 
l.seq + 1 seq 
S.$$DIMKEYR_01 
S.$$DIMKEYR__02 
s.$$DIMKEYR_03 
s.$$DIMKEYR_04 
s.$$DIMKEYR_05 
s.$$DIMKEYR_06 
S.$$DIMKEYR_07 
s.$$DIMKEYR_08 
s.$$DIMKEYR_09 
s.$$DIMKEYR_10 
S.$$DEGKEY_01 
s.$$DEGKEY_02 
S . $$DEGKEY 03. 



-l.$$FCTCOL_001 
-l.$$FCTCOL_002 
-l.$$FCTCOL_003 
-l.$$FCTCOL__004 
-l.$$FCTCOL_005 
-l.$$FCTCOL_006 
-l.$$FCTCOL__007 
-l.$$FCTCOL_008 
-l.$$FCTCOL 009 



$$FCTCOL_001 
$$FCTCOL_002 
$$FCTCOL_003 
$$FCTCOL_004 
$$FCTCOL_005 
$$FCTCOL~006 
$$FCTCOL_007 
$$FCTCOL_008 
$$FCTCOL 009 
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ji- 



-l.$$FCTCOL 
-l.$$FCTCOL~ 

-i.$$fctcol~ 
-i.$$fctcol~ 
-i.$$fctcol" 
-i.$$fctcol~ 
-i.$$fctcol" 
-i.$$fctcol" 
-i.$$fctcol" 

-l.$$FCTCOL 
-l.$$FCTCOL 
-l.$$FCTCOL 
-l.$$FCTCOL 
-l.$$FCTCOL* 
-l.$$FCTCOL 



010 $$FCTCOL_010 
'Oil $$FCTCOL_011 
"012 $$FCTCOL_012 
"013 $$FCTCOL_013 
"014 $$FCTCOL_014 
"015 $$FCTCOL_015 
"016 $$FCTCOL_016 
"017 $$FCTCOL_017 
"018 $$FCTCOL_018 
"019 $$FCTCOL_019 
"020 $$FCTCOL_020 
"021 $$FCTCOL_021 
"022 $$FCTCOL_022 
"023 $$FCTCOL_023 
"024 $$FCTCOL_024 



$ $ SELECT_I NTO_BODY [ $ $ FCTTBL t ] _I R 3 
FROM 

$$FCTTBL[]_IL 1, $$FCTTBL[]_1ST S 
WHERE l.iss » s.iss AND l.ssjcey » s.ss_key 

— #BLOCK_END# MakeIR 

/****+****★**********+******************************************************* 

— Insert BOOKs for changed dim keys where fact 

— also changed 

— When a dimension changes at the same time as 

— a fact then we need to make up the fact difference 

~ 1ST shoud be indexed 

— Note that we add two to whatever we used as the last 

— seq because this transaction occurs on the same 

— date as the negative and positive ones above 

— Note also that the Left Outer join uses transtype_key 

— so that only the Bookings at the old value will be counted. 

— Whereas above for the negative transaction value 

— we want to include Shipments in our calculation, here 

— we only want to see how Booking Facts have changed. 

— Here again, only one Booking transaction type is supported 

— per ss_key 

— IRD: Insert Rebook delta 

/***********★************** ******************** ****************************** 

— #BLOCK_BEGIN# MakeIRD 

$ $ SELECT_INTO_BEGIN [$$ FCTTBL [ ] _IRD] 
SELECT 

s.iss, 
s.ss_key, 
s.date_key, 
s . transtype__key, 
l.seq + 2 seq 
S.$$DIMKEYR_01 
S.$$DIMKEYR_02 
s.$$DIMKEYR_03 
s.$$DIMKEYR_04 
s.$$DIMKEYR_05 
S.$$DIMKEYR_06 
S.$$DIMKEYR_07 
S.$$DIMKEYR_08 
S.S$DIMKEYR_09 
S.$$DIMKEYR_10 
S.$$DEGKEY_01 
S.$$DEGKEY_02 
S . $$DEGKEY 03 



******* / 



******* j 
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MAX(S. 
MAX(S. 
MAX (S . 
MAX (s . 
MAX(s. 
MAX(S. 
MAX(s. 
MAX(s. 
MAX(s. 
MAX(s. 
MAX (S. 
MAX(S. 
MAX (S . 
MAX(S. 
MAX(s. 
MAX(S. 
MAX(s. 
MAX(S. 
MAX(s. 
MAX(S. 
MAX(s. 
MAX<S. 
MAX (S . 
MAX(s. 



$$FCTCOL 

$$FCTCOL~ 

$$FCTCOL 

$$fctcol" 

$$FCTCOL_ 

$$FCTCOL 

$$FCTCOL~ 

$$FCTCOL~ 

$$FCTCOL~ 

$$FCTCOL~ 

$$FCTCOL~ 

$$fctcol~ 
$$fctcol~ 
$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol~ 
$$fctcol" 
$$fctcol 

,$$FCTCOL 

> $$fctcol" 



001) - 

002) ■ 

003) - 
004) 
005) 
006) 
007) 
008) 
009) 
010) 
"Oil) 
"012) 
013) 
'014) 
"015) 
"016) 
"017) 
"018) 
"019) 
"020) 
"021) 
"022) 
"023) 
"024) 



-$$NVL[SUM(f . 
-$$NVL(SUM(f . 
-$$NVL(SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL(SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f , 



$$FCTCOL 
$$FCTCOL~ 
$$FCTCOL~ 
$$FCTCOL~ 
$$FCTCOL~ 
$$FCTCOL~ 
$$FCTCOL~ 
$$FCTCOL_ 
$$FCTCOL_ 
$$FCTCOL_ 
$$FCTCOL_ 
$$FCTCOL 
$$FCTCOL~ 
$$FCTCOL~ 
$$FCTCOL~ 
$$FCTCOL~ 
$$FCTCOL_ 
$$FCTCOL_ 
$$FCTCOL_ 
$$FCTCOL_ 
$$FCTCOL 
$$FCTCOL~ 
$$FCTCOL~ 

$$fctcol" 



001) 


- , ~ 


03 


$$FCTCOL 


001 


002) 




0] 


$$FCTCOL 


"002 


003) 




0] 


$$fctcol" 


"003 


004) 


~ , ~ 


0] 


$$FCTCOL~ 


'004 


005) 


*-/ ~~ 


0] 


$$fctcol" 


"005 


006) 




0] 


$$fctcol~ 


"006 


007) 




0] 


$$fctcol~ 


"007 


008) 


~ 


0] 


$$FCTCOL 


"008 


009) 




0] 


$$fctcol" 


'009 


010) 


~, ~ 


0] 


$$fctcol" 


"010 


Oil) 




0] 


$$fctcol" 


"on 


012) 


-/ ~ 


0] 


$$fctcol" 


'012 


013) 




0] 


$$fctcol" 


"013 


014) 


~ 


0] 


$$fctcol~ 


"014 


JUS) 




0] 


$$fctcol" 


"015 


016) 




03 


55FCTCOL 


016 


017) 




0] 


$$fctcol" 


"017 


018) 




0] 


$$fctcol" 


"018 


019) 




0] 


$$fctcol~ 


'019 


020) 




0] 


$$fctcol" 


"020 


021) 




03 


$$fctcol" 


"021 


022) 




0] 


$$fctcol" 


'022 


023) 




0] 


$$fctcol" 


"023 


, 024) 




0] 


$$fctcol" 


"024 



$$SELECT_INTO_BODY[$$FCTTBL[]_IRD] 
FROM 

$$FCTTBL[]_IL 1, $$FCTTBL[]_1ST s 

$$LOJ_FROM[$$FCTTBL[]$$CURR f s.iss «■ f.iss AND s.ssjcey = f.ssjcey AND 

s.transtypejcey - f . transtype_key3 
WHERE 

l.iss = s.iss AND l.ssjcey = s.ss_key 
$$JOIN_WHERE[ s.iss - f.iss (+) AND s.ss_key - f.ssjcey (+) AND s . transtypejcey = 
f .transtype_key (+) ] 
GROUP BY 

s . iss, 

s . ss_key, 

s ,date_key, 

s . transtypejcey , 

l.seq 

s.$$DIMKEYR_01 
S.$$DIMKEYR_02 
S.$$DIMKEYR_03 
s.$$DIMKEYR_04 
S.$$DIMKEYR_05 
s.$$DIMKEYR_06 
s.$$DIMKEYR_07 
s.$$DIMKEYR_08 
S.$$DIMKEYR_09 
s.$$DIMKEYR_10 
s.$$DEGKEY_01 
s.$$DEGKEY_02 
S.$$DEGKEY 03 



HAVING 

OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 



($$NVL 
($$NVL 
($$NVL 
($$NVL 
($$NVL 
($$NVL 
($$NVL 
($$NVL 
($$NVL 
($$NVL 
($$NVL 
($SNVL 
($$NVL 
($$NVL 
($$NVL 
{$$NVL 



[SUM(f . 
[SUM(f . 
[SUM(f . 
[SUM(f . 
[SUM(f . 
[SUM(f . 
[SUM(f . 
[SUM(f . 
SUM(f . 
(SUM(f , 
SUM(f . 
[SUM(f . 
[SUM<f 
[SUM(f . 
[SUM(f 
[SUM(f 



$$FCTCOL 
$$FCTCOL" 

$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol~ 
$$fctcol] 
$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol" 

$$FCTCOL 
$$FCTCOL 



001) 
002) 
"003) 
'004) 
'005) 
"006) 
"007) 
'008) 
'009) 
"010) 
"011) 
"012) 
"013) 
"014) 
"015) 
"016) 



- 03 <> 

- 0] <> 
~ 03 <> 

<> 
<> 
<> 



0] 
0) 
0] 



~ 03 <> 

- 0] 

- 03 

- 0] 

- 0] 

- 03 

- 0J <> 
~ 03 <> 
~ 0] <> 

- 01 <> 



MAX(s. 
MAX(S 
MAX(s 
MAX(s 
MAX(s 
MAX (s 
MAX (s 
MAX(s 
MAX (s 
MAX (S 
MAX (S 
MAX(s 
MAX (s 
MAX (S 
MAX(S 
MAX (S 



$$FCTCOL 

$$FCTCOL~ 

$$FCTCOL" 

$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol" 
,$$fctcol" 
,$$fctcol" 
,$$fctcol" 
,$$fctcol" 
.$$fctcol" 
,$$fctcol" 
,$$fctcol" 
,$$fctcql~ 



001) ) 

002) ) 

003) ) 

004) ) 

005) ) 

006) ) 

007) ) 

008) ) 

009) ) 

010) ) 

011) ) 

012) ) 

013) ) 

014) ) 

015) ) 

016) ) 
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OR 


($$NVL[SUM(f 


$$FCTCOL 


017) 


OR 


($$NVL[SUM(f 


$$fctcol" 


"018) 


OR 


($$NVL[SUM(f 


$$fctcol~ 


"019) 


OR 


($$NVL[SUM(f 


$$FCTCOL~ 


"020) 


OR 


($$NVL[SUM(f 


$$fctcol" 


"021) 


OR 


($$NVL[SUM{f 


$$fctcol" 


"022) 


OR 


($$NVL[SUM(f 


$$fctcol" 


"023) 


OR 


{$$NVL[SUM(f 


$$fctcol" 


"024) 



0] <> MAX (s 

0] <> MAX(S 

0] <> MAX(s 

0] <> MAX(S 

0] <> MAX(s 

0] <> MAX(S 

0] <> MAX(s 

0] <> MAX (s 



, $$FCTCOL_017) ) 
. $$FCTCOL_018) ) 
,$$FCTCOL_019) ) 
,$$FCTCOL_020) ) 
,$$FCTCOL_021) ) 
,$$FCTCOL_022) ) 
,$$FCTCOL_023) ) 
,$$FCTCOL 024)) 



-#BLOCK END# MakeIRD 



*************************** / 



* + ********★****** + *★ + * + *******************************■* 

— Insert BOOKS for deltas with same dim keys OR for 
-- brand new orders . 

— Note that we DON'T want to count Shipments 

— (so shipment ssjcey's should be different from 
order ss_keys) since we just want bookings to sum up 

-- to whatever this transcation says they should be. 

-- Fact table should be indexed 

— WHERE clause prevents double booking on changed 

— dimension - if we didn't use the NOT EXISTS clause 

— then this query would repeat the work of the last one 

— above - which we have already taken care of 

— HAVING clause ensures that multiple 0 records don't 

— get inserted whenever this procedure is run 

— Note that we increment the sequence number just in case 

— this new transaction occurs on the same date as the last 

— existing one in the fact table - to avoid index errors 

— IND: Insert New Delta 

/***********************************************************************************/ 

— #BLOCK_BEGIN# MakeIND 

$$SELECT_INTO_BEGIN [$$FCTTBL[ ]_IND] 
SELECT 

S.iss, 
s.ssjcey, 
s.date_key, 
s . transtype_key, 
$$NVL[MAX(f .seq) 
S.$$DIMKEYR_01 
s.$$DIMKEYR_02 
S.$$DIMKEYR_03 
s.$$DIMKEYR_04 
s.$$DIMKEYR_05 
s.$$DIMKEYR_06 
s.$$DIMKEYR_07 
s.$$DIMKEYR_08 
S.$$DIMKEYR_09 
S.$$DIMKEYR_10 
s.$$DEGKEY_01 
s.$$DEGKEY_02 
s.$$DEGKEY 03 



-,-0] +1 seq 



MAX(s 
MAX(s 
MAX(S 
MAX (s 
MAX(s 
MAX(S 
MAX(s 
MAX(S 
MAX(S 
MAX (s 
MAX (s 



$$FCTCOL 
$$FCTCOL 
$$FCTCOL 
$$FCTCOL 
$$FCTCOL" 

$$fctcol" 

$$FCTCOL 

,$$fctcol" 

,$$FCTCOL 
,$$FCTCOL 
■$$FCTCQL 



001) 
"002) 
"003) 
"004) 
"005) 
"006) 
"007) 
"008) 
"009) 
"010) 
"011) 



-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM<f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 



$$FCTCOL 
$$FCTCOL~ 
$$FCTCOL _ 
$$FCTCOL~ 

$$fctcol" 

$$FCTCOL 

$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol" 
$$fctcol" 



001) 
002) 
003) 
004) 
005) 
006) 
007) 
008) 
009) 
010) 
011) 



0] 
0] 
0] 
OJ 
0] 
0] 
0) 
0] 
0] 
0] 
0] 



$$FCTCOL_001 
$$FCTCOL_002 
$$FCTCOL_003 
$$FCTCOL_004 
$$FCTCOL_005 
$$FCTCOL_006 
$$FCTCOL_007 
$$FCTCOL_008 
$$FCTCOL_009 
$$FCTCOL_010 
$$FCTCOL 011 
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MAX(s 
MAX (S 
MAX (S 
MAX (S 
MAX(S 
MAX (S 
MAX(S 
MAX(S 
MAX(S 
MAX(S 
MAX(s 
MAX (s 
MAX(S 



$$ FCTCOL 
$$ FCTCOL 
$$ FCTCOL 
$$ FCTCOL* 
,$$FCTCOL 
,$$FCTCOL 
,$$FCTCOL 
,$$ FCTCOL 
,$$FCTCOL 
.S$FCTCOL 
.$$FCTCOL 
.$$FCTCOL 
,$$FCTCOL 



012) 
"013) 
"014) 
"015) 
"016) 
"017) 
"018) 
"019) 
"020) 
"021) 
"022) 
"023) 
"024) 



-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM(f . 
-$SNVL[SUM(f . 
-$$NVL[SOM(f . 
-$$NVL[SUM(f . 
-$$NVL[SUM<f , 
-$$NVL[SUM(f , 
-$$NVLtStFM(f , 
-$$NVL[SUM(f , 
-$$NVL[SUM(f , 
-$$NVL[SUM(f , 



$$ FCTCOL 
$$FCTCOL" 

$$fctcol~ 
$$fctcol" 

$$FCTCOL~ 
$$FCTCOL" 

$$fctcol" 

$$FCTCOL~ 
$$FCTCOL" 

$$fctcol" 
$$fctcol" 
$$fctcol~ 
$$fctcol" 



012) 
013) 
014) 
015) 
016) 
017) 
018) 
019) 
020) 
021) 
022) 
023) 
024) 



0) 
0] 
0] 
0) 
0] 
0) 
0] 
0] 
0] 
0] 
0] 
0] 
0] 



$$FCTCOL_012 
$$FCTCOL_013 
$$FCTCOL_014 
$$FCTCOL_015 
$$FCTCOL_016 
$$FCTCOL_017 
$$FCTCOL_018 
$$FCTCOL_019 
$$FCTCOL_020 
$$FCTCOL_021 
$$FCTCOL_022 
$$FCTCOL_023 
$$FCTCOL 024 



$$SELECT_INTO_BODY [ $$FCTTBL [ ]_IND] 
FROM 

$$FCTTBL[]_1ST S $$LOJ_FROM[$$FCTTBL[] $$CURR f -,~ 

s.iss = f.iss AND s.ssjcey = f.ss_key AND f . trans type_key = s . transtypejcey] 
WHERE 

NOT EXISTS (SELECT * FROM $$FCTTBL [ ) _IL WHERE iss = s.iss AND ss_key = s.ss_key) 
$$JOIN_WHERE [s.iss = f.iss (+) AND s.ss_key = f.ss_key (+) AND s . transtype_key = 
f .trans type_key (+) ] 
GROUP BY 

s. iss, 
s. ss_key, 
s.date_key, 
s . trans type_key 
s.$$DIMKEYR_01 
s.$$DIMKEYR_02 
S.$$DIMKEYR_03 
s.$$DIMKEYR_04 
s.$$DIMKEYR_05 
s.$$DIMKEYR_06 
s.$$DIMKEYR_07 
S.$$DIMKEYR_08 
S.$$DIMKEYR_09 
s.$$DIMKEYR_10 
s.$$DEGKEY_01 
s.$$DEGKEY_02 
S . $$DEGKEY 03 



HAVING 
















($$NVL[SUM(f . 


$$ FCTCOL 


001) 




0] 


<> 


OR 


($$NVL[SUM(f . 


$$ FCTCOL" 


002) 




0] 


<> 


OR 


<$$NVL[SUM(f . 


$$ FCTCOL" 


003) 




0] 


<> 


OR 


($$NVL[SUM(f . 


$$ FCTCOL" 


'004) 




0] 


<> 


OR 


($$NVL[SUM(f . 


$$ FCTCOL" 


'005) 




0] 


<> 


OR 


($$NVL[SUM(f . 


$$FCTCOL" 


"006) 




0] 


<> 


OR 


($$NVL[SUM(f . 


$$ FCTCOL" 


'007) 




0] 


<> 


OR 


($$NVL[SUM(f . 


$$ FCTCOL" 


"008) 




0] 


<> 


OR 


($$NVL[SUM(f . 


$$ FCTCOL" 


"009) 




0] 


<> 


OR 


($$NVL[SUM(f 


$$ FCTCOL" 


"010) 




0] 


<> 


OR 


($$NVL[SUM(f 


$$ FCTCOL" 


"011) 




0] 


<> 


OR 


($$NVL[SUM(f 


$$FCTCOL~ 


"012) 




0} 


<> 


OR 


($$NVL[SUM(f ,$$FCTCOL 


"013) 




0] 


<> 


OR 


($$NVL[SUM(f 


$$ FCTCOL 


"014) 




0] 


<> 


. OR 


($$NVL[SUM(f 


$$fctcol" 


"015) 




0] 


<> 


OR 


($$NVL[SUM(f .$$FCTCOL 


"016) 




0] 


<> 


OR 


($$NVL[SUM{f 


.$$FCTCOL 


"017) 




0] 


<> 


OR 


($$NVL[SUM(f 


.$$FCTCOL" 


"018) 




0) 


<> 


OR 


($$NVL[SUM(f 


.$$fctcol" 


"019) 




0) 


<> 


OR 


{$$NVL[SUM(f 


.$$fctcol" 


"020) 




0] 


<> 


OR 


( $ $NVL [ SUM ( f . $ $ FCTCOL 


"021) 




0) 


<> 


OR 


($$NVL[SUM(f .$$FCTCOL 


"022) 




0) 


<> 


OR 


($$NVL[SUM(f 


.$$FCTCOL 


"023) 




0] 


<> 


OR 


( $ $ NVL [ SUM ( f . $ $ FCTCOL 


"024) 




0] 


<> 



MAX(S 
MAX(S 
MAX(S 
MAX(S 
MAX(S 
MAX(S 
MAX (S 
MAX(S 
MAX (S 
MAX(S 
MAX (s 
MAX (S 
MAX (S 
MAX (s 
MAX{S 
MAX(S 
MAX(S 
MAX(S 
MAX(S 
MAX{S 
MAX(S 
MAX(S 
MAX(S 
MAX(S 



$$FCTCOL_ 
$ $ FCTCOL 
$$ FCTCOL" 
$$ FCTCOL 
$$ FCTCOL" 
$$ FCTCOL" 
$$ FCTCOL" 
$$ FCTCOL 
$$ FCTCOL" 
$$ FCTCOL" 
$$ FCTCOL" 
$$ FCTCOL" 
$$ FCTCOL" 
$$ FCTCOL" 
,$$ FCTCOL" 

,$$fctcol" 
,$$fctcol" 

, $$FCTCOL" 
,$$ FCTCOL" 
,$$FCTCOL" 

,$$fctcol" 
,$$fctcol" 
, $ $ fctcol" 

. $$ FCTCOL 



001) ) 

002) ) 

003) ) 

004) ) 

005) ) 

006) ) 

007) ) 

008) ) 

009) ) 

010) ) 

011) ) 

012) ) 

013) ) 

014) ) 

015) ) 

016) ) 

017) ) 

018) ) 

019) ) 

020) ) 

021) ) 

022) ) 

023) ) 

024) ) 



--#BLOCK_END# MakeIND 

/******************************.*****************************************************/ 
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3W 



s 1 



— Form pairwise deltas for all rows except earliest for each sskey 

— Each row created in NFD will consist of two sequential entries from the 

™ staing table. So if N enties for an order exist in MFL (after we have filtered 

— out same-date duplicates) then all the queries above will deal with the earliest entry, 
whereas 

— all the queries below (including this one) will deal with the N-l deltaing transactions 

— This query assumes that MFL will already have been filtered 

— to have a single record for each order/datekey 

— NFD: Not First Delta 

/* ************+***★****★****★*********+*************+********************* **********/ 
— #BL0CK_BEGIN# MakeNFD 

$$SELECT_INTO_BEGIN [ $$FCTTBL [ ] _NFD] 
SELECT 

s.iss siss, t.iss tiss 
s.ss_key sssjcey, t.ssjcey tss_key 



.date_key sdate_key, t.date_key tdatejcey 



S.uuv^wj ~ , _ - 

s.transtype key stranstypejcey, t . transtype_key ttranstype_key 
S.$$DIMKEYR~01 s$$DIMKEYR_01, t . $$DIMKEYR_01 t$$DIMKEYR_01 
S.$$DIMKEYR_02 S$$DIMKEYRJ)2 , 
s.$$DIMKEYR_03 s$$DIMKEYR_03 , 
s.$$DIMKEYR_04 s$$DIMKEYR_04 , 
S.$$DIMKEYR_05 s$$DIMKEYR_05 , 
s.$$DIMKEYR_06 s$$DIMKEYR_06, 
S.$$DIMKEYR_07 s$$DIMKEYR_07 , 
S.$$DIMKEYR_08 s$$DIMKEYR_08 , 
S.$$DIMKEYR_09 S$$DIMKEYR_09, 
s.$$DIMKEYR_10 s$$DIMKEYR_10, 
s.$$DEGKEY_01 s$$DEGKEY_01 , t 
s.$$DEGKEY_02 s$$DEGKEY_02 , t 
S-SSDEGKEY 03 s$$DEGKEY 03, t 



t.$$DIMKEYR_02 t$$DIMKEYR_02 
t.$$DIMKEYR_03 t$$DIMKEYR_03 
t.$$DIMKEYR_04 t$$DIMKEYR_04 
t.$$DIMKEYR_05 t$$DIMKEYR_05 
t.$$DIMKEYR_06 t$$DIMKEYR_06 
t.$$DIMKEYR_07 t$$DIMKEYR_07 
t.$$DIMKEYR_08 t$$DIMKEYR_08 
t.$$DIMKEYR_09 t $ $ D I MKE YR_0 9 
t.$$DIMKEYR_10 t$$DIMKEYR_10 
. $$DEGKEY_01 t$$DEGKEY_01 
. $ $ DEGKE Y_0 2 t $ $ DEGKE Y J) 2 
,$$DEGKEY_03 t$$DEGKEY 03 



s . 


$$FCTCOL~ 


001 


s$$FCTCOL 


001, 


t. 


$$FCTCOL 


001 


t$$FCTCOL 


001 


s . 


$$FCTCOL~ 


'002 


s$$fctcol" 


002, 


t. 


$$fctcol" 


'002 


t$$FCTCOL~ 


002 


s. 


$$FCTCOL~ 


'003 


s$$fctcol" 


003, 


t. 


$$fctcol 


"003 


t$$FCTCOL~ 


"003 


s . 


$$fctcol" 


"004 


s$$fctcol" 


'004, 


t. 


$$fctcol" 


"004 


t$$FCTCOL~ 


'004 


s 


$$fctcol~ 


"005 


s$$fctcol" 


"005,. 


t. 


$$fctcol" 


"005 


t$$FCTCOL~ 


'005 


s 


$$fctcol" 


'006 


s$$fctcol" 


'006, 


t 


$$fctcol" 


"006 


t$$FCTCOL~ 


"006 


s 


$$fctcol" 


"007 


s$$fctcol" 


'007, 


t 


$$fctcol~ 


"007 


t$$FCTCOL~ 


"007 


s 


$$fctcol" 


"008 


s$$fctcol" 


'008, 


t 


$$fctcol 


"008 


t$$FCTCOL~ 


'008 


s 


$$fctcol~ 


"009 


S$$FCTCOL~ 


'009, 


t 


$$fctcol" 


"009 


t$$FCTCOL~ 


"009 


s 


$$fctcol" 


'010 


s$$FCTCOL~ 


'010, 


t 


$$fctcol" 


"010 


t$$FCTCOL~ 


"010 


s 


$$fctcol" 


"011 


s$$fctcol" 


"011, 


t 


$$fctcol" 


"011 


t$$FCTCOL~ 


'011 


s 


$$fctcol~ 


'012 


s$$fctcol" 


"012, 


t 


$$fctcol~ 


"012 


t$$FCTCOL~ 


'012 


s 


$$fctcol~ 


"013 


s$$fctcol" 


"013, 


t 


$$fctcol~ 


"013 


t$$FCTCOL~ 


'013 


s 


$$fctcol" 


"014 


s$$fctcol" 


'014, 


t 


$$fctcol~ 


"014 


t$$FCTCOL~ 


"014 


s 


$$fctcol~ 


"015 


s$$fctcol" 


"015, 


t 


$$fctcol~ 


"015 


t$$FCTCOL~ 


"015 


s 


$$fctcol~ 


"016 


s$$fctcol" 


'016, 


t 


$$fctcol~ 


"016 


t$$FCTCOL" 


"016 


s 


,$$fctcol~ 


"017 


s$$fctcol" 


"017, 


t 


,$$fctcol" 


"017 


t$$FCTCOL~ 


"017 


s 


.$$fctcol" 


"018 


s$$fctcol" 


"018, 


t 


.$$fctcol" 


"018 


t$$FCTCOL~ 


"018 


s 


,$$fctcol" 


"019 


s$$fctcol" 


"019, 


t 


.$$fctcol~ 


"019 


t$$FCTCOL~ 


'019 


s 


.$$fctcol" 


"020 


s$$fctcol" 


"020, 


t 


.$$fctcol" 


"020 


t$$FCTCOL~ 


"020 


s 


.$$fctcol" 


"021 


s$$fctcol" 


"021, 


t 


.$$fctcol" 


"021 


t$$FCTCOL~ 


"021 


s 


.$$fctcol~ 


"022 


s$$fctcol" 


"022, 


t 


.$$fctcol" 


"022 


t$$FCTCOL" 


"022 


s 


.$$fctcol~ 


"023 


s$$fctcol" 


"023, 


t 


.$$fctcol" 


"023 


t$$FCTCOL~ 


"023 


s 


.$$fctcol' 


"024 


s$$fctcol" 


"024, 


t 


.$$fctcol" 


"024 


t$$FCTCOL" 


'024 



$$SELECT_INTO_BODY[$$FCTTBL [ ] _NFD] 
FROM 

$ $ FCTTBL [ ] _MFL S, $$FCTTBL [ ] _MFL t 

WHERE 

s.iss = t.iss AND s.ss_key = t.ss_key 

AND 

s.datejcey = (SELECT MAX(date_key) FROM $$ FCTTBL [] _MFL u WHERE 
u.iss = s.iss AND u.ss_key = s.ss_key AND u.date_key < t.date_key) 

— #BLOCK END# MakeNFD 
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-- Insert BOOKs for deltas with same dim keys 


-- If the dimensions don't change then we create a 


— new booking order (as long as at 


least one of the facts 


— have changed) 




— I DM: Insert Delta More 




/********************************************** 


— #BLOCK_BEGIN# MakelDM 




$$SELECT INTO_BEGIN[$$FCTTBL[]_IDM] 




SELECT 




tiss iss, 




tss_key ss_key, 




tdate key date key, 




ttranstype_key transtype_key, 


0 seq 




t$$DIMKEYR 01 $$DIMKEYR 01 




t$$DIMKEYR 02 $$DIMKEYR 02 




t$$DIMKEYR 03 $$DIMKEYR 03 




t$$DIMKEYR 04 $$DIMKEYR 04 




t$$DIMKEYR 05 $$DIMKEYR 05 




t$SDIMKEYR 06 $$DIMKEYR 06 




t$$DIMKEYR 07 $$DIMKEYR 07 




t$$DIMKEYR 08 $$DIMKEYR 08 




t$$DIMKEYR 09 $$DIMKEYR 09 




t$$DIMKEYR 10 $$DIMKEYR 10 




t$SDEGKEY 01 $$DEGKEY 01 




t$$DEGKEY 02 $$DEGKEY 02 




t$$DEGKEY_03 $$DEGKEY_03 




t$$FCTCOL 001-s$$FCTCOL 001 


$$FCTCOL 001 


, t$$FCTCOL 002-s$$FCTCOL 002 


$$FCTCOL 002 


t$$FCTCOL 003-s$$FCTCOL 003 


$$FCTCOL 003 


, t$$FCTCOL 004-S$$FCTCOL 004 


$$FCTCOL 004 


t$$FCTC0L 005-S$$FCTCOL 005 


$$FCTCOL 005 


, t$$FCTCOL 006-s$$FCTCOL_006 


$$FCTCOL 006 


t$$FCTC0L 007-s$$FCTCOL_007 


$$FCTCOL 007 


t$$FCTCOL 008-s$$FCTCOL_008 


$$FCTCOL 008 


t$$FCTCOL 009-s$$FCTCOL_009 


$$FCTCOL 009 


t$$FCTCOL 010-S$$FCTCOL 010 


$$FCTCOL 010 


t$$FCTCOL 011-S$$FCTCOL 011 


$$FCTCOL 011 


t$$FCTCOL 012-S$$FCTCOL 012 $$FCTCOL_012 


t$$FCTCOL 013-S$$FCTCOL 013 


$$FCTCOL 013 


t$$FCTCOL 014-S$$FCTCOL_014 


$$FCTCOL 014 


, t$$FCTCOL 015-s$$FCTCOL 015 


$$FCTCOL 015 


t$$FCTCOL 016-S$$FCTCOL 016 


$$FCTCOL 016 


t$$FCTCOL 017-s$$FCTCOL 017 


$$FCTCOL 017 


t$$FCTCOL 018-s$$FCTCOL_018 


$$FCTCOL 018 


t$$FCTCOL 019-s$$FCTCOL 019 


$$FCTCOL 019 


t$$FCTCOL 020-s$$FCTCOL 020 


$$FCTCOL 020 


t$$FCTCOL 021-s$$FCTCOL 021 


$$FCTCOL 021 


t$$FCTCOL 022-s$$FCTCOL 022 


$$FCTCOL 022 


t$$FCTCOL 023-S$$FCTCOL 023 


$$FCTCOL 023 


t$$FCTCOL_024-s$$FCTCOL_024 


$$FCTCOL_024 


$$SELECT INTO_B0DY[$$FCTTBL[]_IDM] 




FROM 




$$FCTTBL[] NFD d 




WHERE 




( 

(s$$DIMKEYR 06 = t$$DIMKEYR 


06) AND 


(S$$DIMKEYR 05 = t$$DIMKEYR 


"05) AND 


(S$$DIMKEYR 07 = t$$DIMKEYR 


"07) AND 


(S$$DIMKEYR 04 = t$$DIMKEYR 


"04) AND 


(s$$DIMKEYR 08 = t$$DIMKEYR 08) AND 


(s$$DIMKEYR 03 = t$$DIMKEYR 


03) AND 



Method and Apparatus for Creating a Well- PATENT Inventors: Craig D. Weissman, 

Formed Database System Using a Computer Page 1 14 Greg V. Walsh and Eliot L. Wegbreit 

Attorney Docket No. 20308710 
C:\NRPORTBL\PALibl\acw\1058393.1 



(s$$DIMKEYR_09 
<S$$DIMKEYR_02 
<s$$DIMKEYR_10 
(s$$DIMKEYR_01 
) 



= t $ $ DIMKE YR_0 9 ) AND 

- t$$DIMKEYR_02) AND 

= t$$DIMKEYR_10) AND 
= t$$DIMKEYR_01) 



AND 

( 

<s$$FCTCOL_001 <> t$$FCTCOL_001) 

OR (s$$FCTCOL_002 <> t$$FCTCOL_002 ) 

OR (s$$FCTCOL_003 <> t$$FCTCOL_003) 

OR (s$$FCTCOL_004 <> t$$FCTCOL_004 ) 

OR (s$$FCTCOL_005 <> t$$FCTCOL_005 ) 

OR (s$$FCTCOL_006 <> t$$FCTCOL_006) 

OR (s$$FCTCOL_007 <> t$$FCTCOL_007 ) 

OR <s$$FCTCOL_008 <> t$$FCTCOL_008 ) 

OR (s$$FCTCOL_009 <> t$$FCTCOL_009) 

OR (s$$FCTCOL_010 <> t$$FCTCOL_010) 

OR (s$$FCTCOL_011 <> t$$FCTCOL_011) 

OR (s$$FCTCOL_012 <> t$$FCTCOL_012) 

OR (s$$FCTCOL_013 <> t$$FCTCOL_013 ) 

OR (s$$FCTCOL_014 <> t$$FCTCOL_014 ) 

OR (s$$FCTCOL_015 <> t$$FCTCOL_015 ) 

OR (S$$FCTCOL_016 <> t$$FCTCOL_016) 

OR (s$$FCTCOL_017 <> t$$FCTCOL_017 ) 

OR (s$$FCTCOL_018 <> t$$FCTCOL_018 ) 

OR (s$$FCTCOL_019 <> t$$FCTCOL_019) 

OR (s$$FCTCOL_020 <> t$$FCTCOL_020 ) 

OR (s$$FCTCOL_021 <> t$$FCTCOL_021 ) 

OR (s$$FCTCOL_022 <> t$$FCTCOL_022) 

OR (s$$FCTCOL_023 <> t$$FCTCOL_023 ) 

OR (s$$FCTCOL_024 <> t$$FCTCOL_024 ) 



~#BLOCK_END# MakelDM 

/********************************************************* 
~ Insert negative BOOKS for deltas with different dim keys 

— If one of the dimensions change then we first create a lose transaction for 

— all the previous facts. (Negate all the facts from the earlier of the two 

— transactions) 

— ILM: Insert Lost More 

/******************************************************** 



~#BLOCK_BEGIN# MakeILM 

$$SELECT_INTO_BEGIN[$$FCTTBL[]_ILM] 
SELECT 

siss iss, 
sss_key ss_key, 
tdate_key date_key, 
stranstype_key transtype_key, 
0 seq 

s$$DIMKEYR 01 $$DIMKEYR_01 
S$$DIMKEYR~02 $$DIMKEYR_02 
s$$DIMKEYR^03 $$DIMKEYR_03 
S$SDIMKEYR_04 $$DIMKEYR_04 
S$$DIMKEYR_05 $$DIMKEYR_05 
S$$DIMKEYR_06 $$DIMKEYR_06 
S$$DIMKEYR_07 $$DIMKEYR_07 
s$$DIMKEYR_08 $$DIMKEYR_08 
S$$DIMKEYR 09 $$DIMKEYR_09 
s$$DIMKEYR~10 $$DIMKEYR_10 
s$$DEGKEY_01 $$DEGKEY_01 
s$$DEGKEY_02 $$DEGKEY_02 
S$$DEGKEY_03 $$DEGKEY_03 

, -s$$FCTCOL 001 $$FCTCOL 001 
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-s$$FCTCOL_002 $$FCTCOL_002 

-S$$FCTCOL_003 $$FCTCOL_003 

-S$$FCTCOL_004 $$FCTCOL_004 

-S$$FCTCOL_005 $$FCTCOL_005 

-s$$FCTCOL_006 $$FCTCOL_006 

-S$$FCTCOL_007 $$FCTCOL_007 

-s$$FCTCOL_008 $$FCTCOL_0.08 

-s$$FCTCOL_009 $$FCTCOL_009 

-s$$FCTCOL_010 $$FCTCOL_010 

-s$$FCTCOL_011 $$FCTCOL_011 

-s$$FCTCOL_012 $$FCTCOL_012 

-s$$FCTCOL_013 $$FCTCOL_013 

-s$$FCTCOL_014 $$FCTCOL_014 

-s$$FCTCOL_015 $$FCTCOL_01S 

-s$$FCTCOL_016 $$FCTCOL_016 

-s$$FCTCOL 017 $$FCTCOL_017 

-S$$FCTCOlT018 $$FCTCOL_018 

-S$$FCTCOL_019 $$FCTCOL_019 

-S$$FCTCOL 020 $$FCTCOL_020 

-S$$FCTCOL~021 $$FCTCOL_021 

-s$$FCTCOL_022 $$FCTCOL_022 

-S$$FCTCOL_023 $$FCTCOL_023 

-S$$FCTCOL_024 $$FCTCOL_024 

$$SELECT_INTO_BODY [ $$FCTTBL [ ] _ILM] 
FROM 

$ $ FCTTBL [ ] _N FD d 

WHERE 



( 



(S$$DIMKEYR 


06 


<> 


t$$DIMKEYR 


06) 


OR 


(S$$DIMKEYR~ 


"05 


<> 


t$$DIMKEYR~ 


"05) 


OR 


(S$$DIMKEYR~ 


'07 


<> 


t$$DIMKEYR~ 


07) 


OR 


(s$$DIMKEYR~ 


'04 


<> 


t$$DIMKEYR~ 


"04) 


OR 


(s$$DIMKEYR 


"08 


<> 


t$$DIMKEYR~ 


"08) 


OR 


(s$$DIMKEYR~ 


"03 


<> 


t$$DIMKEYR~ 


"03) 


OR 


(S$$DIMKEYR~ 


"09 


<> 


t$$DIMKEYR~ 


"09) 


OR 


(S$$DIMKEYR~ 


"02 


<> 


t$$DIMKEYR~ 


"02) 


OR 


(s$$DIMKEYR" 


"10 


<> 


t$$DIMKEYR~ 


"10) 


OR 


(S$$DIMKEYR~ 


"01 


<> 


t$$DIMKEYR~ 


"01) 





) 



AND 



OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 
OR 



(s$$FCTCOL 001 <> 0) 
(S$$FCTCOlT002 <> 0) 
(s$$FCTCOL_003 <> 0) 
(s$$FCTCOL 004 <> 0) 
(s$$FCTCOL~005 <> 0) 
(s$$FCTCOL_006 <> 0) 
(s$$FCTCOL_007 <> 0] 
(s$$FCTCOL_008 <> 0] 
(s$$FCTCOL 009 <> 0] 
<s$$FCTCOlT010 <> 0] 
(s$$FCTCOLj)ll <> 0] 
<s$$FCTCOL_012 <> 0; 
(s$$FCTCOLJH3 <> 0; 
(s$$FCTCOL_014 <> 0; 
(sS$FCTCOL_015 <> 0; 
(s$$FCTCOL_016 <> 0; 
(S$$FCTCOL_017 <> 0 
(s$$FCTCOL_018 <> 0 
(S$$FCTCOL_019 <> 0 
<s$$FCTCOL_020 <> 0 
(S$$FCTCOL_021 <> 0 
(s$$FCTCOL_022 <> 0 
(s$$FCTCOL_023 <> 0 
(s$$FCTCOL_024 <> 0 

) r. 



— # BLOCK END# MakeILM 
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-- Insert BOOKs for deltas with different dim keys 

— When a dimension key changes then we can simply insert all the new facts with the 
-- new dimension keys 

-- Note that seq = 1 here because this is the second transaction on this date for 

— this order. 

— IRM: Insert Rebook More 

/***★ + ******★★★*+** *************************** *■*■****+**** + + *★****•** + ****■**★*★★*****■*★/ 
— #BL0CK_BEGIN# MakeIRM 

$ $SELECT_INTO_BEGIN [ $$FCTTBL [ ] _IRM] 
SELECT 

tiss iss, 
tss_key ss_key, 
tdate_key date_key, 
ttranstype_key transtype_key, 
1 seq 

t$$DIMKEYR_01 $$DIMKEYR_01 
t$$DIMKEYR_02 $$DIMKEYR_02 
t$$DIMKEYR_03 $$DIMKEYR_03 
t$$DIMKEYR_04 $$DIMKEYR_04 
t $ $ DIMKE YR_0 5 $$DIMKEYR_05 
t $ $ DIMKE YR_0 6 $$DIMKEYR_06 
t$$DIMKEYR_07 $$DIMKEYR_07 
t$$DIMKEYR_08 $$DIMKEYR_08 
t $ $ DIMKE YR_0 9 $$DIMKEYR_09 
t $ $ DIMKE YR_1 0 $$DIMKEYR_10 
t$$DEGKEY_01 $$DEGKEY_01 
t $ $ DEGKE Y_0 2 $$DEGKEY_02 
t$$DEGKEY_03 S$DEGKEY_03 



t$$FCTCOL_001 
t$$FCTCOL_002 
t$$FCTCOL_003 
t$$FCTCOL_004 
t$$FCTCOL_005 
t$$FCTCOL_006 
t$$FCTCOL_007 
t$$FCTCOL_008 
t$$FCTCOL_009 
t$$FCTCOL_010 
t$$FCTCOL_011 
t$$FCTCOL_012 
t$$FCTCOL_013 
t$$FCTCOL_014 
t$$FCTCOL_015 
t$$FCTCOL_016 
t$$FCTCOL_017 
t$$FCTCOL_018 
t$$FCTCOL_019 
t$$FCTCOL_020 
t$$FCTCOL_021 
t$$FCTCOL_022 
t$$FCTCOL_023 
t$$FCTCOL 024 



$$FCTCOL_001 
$$FCTCOL_002 
$$FCTCOL_003 
$$FCTCOL_004 
$$FCTCOL_005 
$$FCTCOL_006 
$$FCTCOL_007 
$$FCTCOL_008 
$$FCTCOL_009 
$$FCTCOL_010 
$$FCTCOL_011 
$$FCTCOL_012 
$$FCTCOL_013 
$$FCTCOL_014 
$$FCTCOL_015 
$$FCTCOL_016 
$$FCTCOL_017 
$$FCTCOL_018 
$$FCTCOL_019 
$$FCTCOL_020 
$$FCTCOL_021 
$$FCTCOL_022 
$$FCTCOL_023 
$$FCTCOL 024 



$$SELECT_INTO_BODY [$$FCTTBL E ]_IRM] 



FROM 
WHERE 



$$FCTTBL[] NFD d 



( 



<S$$DIMKEYR_06 <> t$$DIMKEYR_06 ) OR 

(s$$DIMKEYR_05 <> t$$DIMKEYR_05 ) OR 

(S$$DIMKEYR_07 <> t$$DIMKEYR_07 ) OR 

(S$$DIMKEYR_04 <> t$$DIMKEYR_04 ) OR 

(S$$DIMKEYR 08 <> t$$DIMKEYR 08) OR 
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(S$$DIMKEYR 


03 


<> 


t$$DIMKEYR 


03) 


OR 


(S$$DIMKEYR 


"09 


<> 


t$$DIMKEYR- 


"09) 


OR 


(s$$DIMKEYR~ 


"02 


<> 


t$$DIMKEYR~ 


"02) 


OR 


(S$$DIMKEYR~ 


"10 


<> 


t$$DIMKEYR~ 


"10) 


OR 


(S$$DIMKEYR~ 


"01 


<> 


t$$DIMKEYR~ 


"01) 





) 

AND 

( 





(t$$FCTCOL 


001 


<> 


0 


OR 


<t$$FCTCOL~ 


"002 


<> 


0 


OR 


(t$$FCTCOL~ 


003 


<> 


0 


OR 


(t$$FCTCOL~ 


004 


<> 


0 


OR 


<t$$FCTCOL~ 


"005 


<> 


0 


OR 


(t$$FCTCOL~ 


006 


<> 


0 


OR 


(t$$FCTCOL~ 


"007 


<> 


0 


OR 


(t$$FCTCOL~ 


"008 


<> 


0 


OR 


(t$$FCTCOL~ 


"009 


<> 


0 


OR 


(t$$FCTCOL~ 


"010 


<> 


0 


OR 


<t$$FCTCOL~ 


'on 


<> 


0 


OR 


(t$$FCTCOL~ 


'012 


<> 


0 


OR 


(t$$FCTCOL~ 


"013 


<> 


0 


OR 


(t$$FCTCOL~ 


"014 


<> 


0 


OR 


(t$$FCTCOL~ 


'015 


<> 


0 


OR 


(t$$FCTCOL~ 


"016 


<> 


0 


OR 


(t$$FCTCOL~ 


"017 


<> 


0 


OR 


(t$$FCTCOL~ 


"018 


<> 


0 


OR 


(t$$FCTCOL~ 


"019 


<> 


0 


OR 


(t$$FCTCOL~ 


"020 


<> 


0 


OR 


(t$$FCTCOL~ 


"021 


<> 


0 


OR 


(t$$FCTCOL* 


*022 


<> 


0 


OR 


(t$$FCTCOL 


"023 


<> 


0 


OR 


(t$$FCTCOL" 


*024 


<> 


0 



) 



— #BLOCK_END# MakeIRM 

/***********************************************************************************/ 

— Delete the output tables 

/♦★if********************************************************************************/ 

— #BLOCK_BEGIN# DropOutput 

$$DDL_BEGIN 

$$DROP_TABLE_IF_EXISTS [ $$FCTTBL [ ] $$NEXT] 
$ $ DROP_TABLE_I F_EXISTS [ $ $ FCTTBL [ ] _INC ] 
$$DDL_END 

— #BLOCK_END# DropOutput 

/+**************************************** ^ 
— Create FC table in case force_close was 

— not run 

/********************************************************************** 
--#BLOCK_BEGIN# MakeFC 

DECLARE $$VAR[fc_exists] $$EPIINT$$EOS 

$ $ DDL_BEGIN_NO_DECLARE 

$$VAR_ASSIGN_BEGIN[fc_exists] 

SELECT COUNT (1) 

$$VAR_ASSIGN_INTO[fc_exists] 

FROM $$ SQLSERVER [ sysob j ects ] $$ ORACLE [ tabs ] 

WHERE 

$$ SQLSERVER [id = object_id ( ' dbo . $$FCTTBL [ ] _FC ' ) AND sysstat & Oxf - 3] 

$$ORACLE[table_name « UPPER {'$$ FCTTBL []_FC f ) ] 

$$VAR_ASSIGN_END 

$$IF[$$VAR[fc_exists] « 0] 

$$DDL EXEC[ 
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$$SELECT_INTO_BEGIN [ $$FCTTBL [ ] _FC] 
SELECT 

* 

$$SELECT_INTO_BODY[$$FCTTBL[]_FC] 
FROM 

$$FCTTBL[]$$CURR 

WHERE 

1=0 

] 

$$END_IF 
$$DDL_END 

— #BLOCK_END# MakeFC 

/★★★★★★★a******************************** 
— Create the incremental table 

/************************************************************************^ 
— #BLOCK_BEGIN # MakeINC 

$ $ SELECT_INTO_BEGIN [ S $ FCTTBL [ ] _INC ] 
SELECT 

$ $SELECT_INTO_BODY [ $ $ FCTTBL [ ] _INC ] 
FROM $$FCTTBL[]_TIN UNION ALL 
SELECT * FROM $$FCTTBL ( ] _IL UNION ALL 
SELECT * FROM $$FCTTBL [ ] ~IR UNION ALL 
SELECT * FROM $$FCTTBL ( ) _IRD UNION ALL 
SELECT * FROM $$FCTTBL [ ] _IND UNION ALL 
SELECT * FROM $$FCTTBL [ ] _IRM UNION ALL 
SELECT * FROM $$FCTTBL [ ] _ILM UNION ALL 
SELECT * FROM $$ FCTTBL [ ] _FC UNION ALL 
SELECT * FROM $$ FCTTBL ( ] IDM 



— #BLOCK_END# MakeINC 

/**************** ****************************^ 

— CR158: We want to load _IMI table and still keep the non-descending 

— order so that the clustered index on a fact table can be created 

— without sorting. This way can speed up significantly in creating a 

— clustered index on a very large already sorted fact table. 

/********************* a*************************************************************/ 

— #BLOCK__BEGIN# MakelMI 

$ $SELECT_INTO_BEGIN [ $$FCTTBL [ ] _IMI ] 
SELECT 

* 

$ $ SELECT_INTO_BODY [ $$ FCTTBL [ ] _IMI ] 
FROM $$FCTTBL[]$$CURR 

WHERE date_key >= (SELECT MIN (date_key) FROM $$ FCTTBL [] _INC) 
UNION ALL 

SELECT * FROM $$ FCTTBL [ }_INC 
$ $SQLSERVER [ ORDER BY 

date_key 
, $$DIMKEYR_01 

$$DIMKEYR_02 
, $$DIMKEYR_03 

$$DIMKEYR_04 

$$DIMKEYR_05 

$$DIMKEYR_06 

$$DIMKEYRJ)7 
, $$DIMKEYR_08 
, $$DIMKEYR_09 

$$DIMKEYR_10 

] 

— #BLOCK_END# MakelMI 

/*****★**********★************** ***************************** ***********************/ 

— Create the new fact table and incremental table 
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— Note that transaction tables must be built before 

— these statements are run 

/*********************************************************************************^ 

--#BL0CK_BEGINff MakeNewFact 

$ $ SELECT_INTO_BEGIN [ $ $ FCTTBL [ ] $ $NEXT ] 
SELECT * 

$ $SELECT_INTO_BODY [$$ FCTTBL [] $ $NEXT ] 
FROM $$FCTTBL[]$$CURR S 

WHERE s.datejcey < (SELECT MIN (date_key) FROM $$ FCTTBL [ ]_INC) 
UNION ALL 

SELECT * FROM $$ FCTTBL [ J _IMI 
— #BLOCK_END# MakeNewFact 

y************ *************************** ***************************** ***************/ 

— Count processed, inserted rows 

/***********************************************************************************/ 

— # BLOCK_BEG I N # SPResults 

DECLARE $$VAR[count_INC] $$EPIINT$$EOS 

BEGIN 

$$VAR_ASSIGN_BEGIN [dount_INC] 
SELECT COUNT (1) 
$$VAR_ASSIGN_INTO [count_INC] 
FROM $$FCTTBL[]_INC 
$$VAR_ASSIGN_END 

INSERT INTO adaptive_template_prof ile (tokenjname, number_rows) 
SELECT 'PROCESSED' , COUNT(l) FROM $ $ FCTTBL []_MFL$$ EOS 

INSERT INTO adaptive_template_prof ile (token_name, number_rows) 

SELECT 'INSERTED' , $$VAR[count_INC] - COUNT(l) FROM $$ FCTTBL [] _TIN$$EOS 

END$$EOS 

— # BLOCK__END# SPResults 

/******************************************************************/ 

— Set join order for SQL Server 

/******************************************************************/ 
— #BLOCK__BEGIN# ForcePlanOff 
$$ SQLSERVER [SET FORCEPLAN OFF] 
— #BLOCK_END# ForcePlanOff 

/***********************************************************************************/ 

— Drop temp tables and TXN and TIN table 

^***********************************************************************************/ 
— #BLOCK_BEGIN# DropTempsAf ter 



$$ddl_begin 

$$drop_table 

$$drop_table~ 

$$drop_table" 

$$drop_table" 

$$drop table" 

$$dropjtable~ 

$$drop_table" 

$$drop_table" 

$$drop_table" 

$$drop_table" 

$$drqp table" 



if_exists 
if_exists 
if_exists 
if_exists 
if_exists 
if_exists 
if_exists 
if_exists 
if_exists 
if_exists 
if exists 



[$$FCTTBL[]_TIN] 

[$$FCTTBL[]_TMI] 

[$$FCTTBL[]_FC] 

[$$FCTTBL[]_TXN] 

[Concat_MFL] 

[$$FCTTBL(]_1ST] 

[$$FCTTBL[]_IL] 

[$$FCTTBL[]_IR] 

t $ $ FCTTBL [ ] _IRD ] 

[$$FCTTBL[J_IND] 

[$SFCTTBL(] NFD] 
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$ $ DROPJT ABLE_ I F_EX I ST S [ $ $ FCTTBL [ ] _I RM ] 
$ $ DROP_TABLE_I F_EXI STS ( $ $ FCTTBL ( ] _I DM ] 
$ $ DROP_TABLE_I F_EX I STS [ $ $ FCTTBL [ ] _I LM ] 
$ $ DROP_TABLE_I F_EXI STS [$$ FCTTBL [ ] _I MI ] 
$$DDL_END 

--#BLOCK_END# DropTempsAf ter 

— #TEMPLATE_END# load_state 
— # T EM P L AT E_BEG I N # load_trans 

/*******************+************************+************************************/ 
~ Copyright * 1997, Epiphany Marketing Software, Inc. All Rights Reserved. 

— load_trans 

— Move transaction-like staging data into Fact table - create a temp 
-- table with TXN extension that has all old rows along with new rows. 

— Also produce a TIN (TXN INC) table that has only the new rows 

— Note that the new table will also include all existing rows from 

— the Fact table. 

/************+***************************+****************************************/ 

— Delete output tables 

— Output table is called TXN and includes old and new rows 

— Also, leave around _TIN as incremental table from this 

— procedure 

— We also create a table called JTMI which contains all the 

— _TIN records plus the records of overlapping period from the 

— old existing fact table. 

~#BLOCK_BEGIN# RemoveOutput 
$$DDL_BEGIN 

$ $ DROP_T ABLE_I F_EXI STS [$$ FCTTBL [ ] _TXN ] 
$ $ DROP_TABLE_I F_EXI STS[$$FCTTBL[] _TMI ] 
$ $ DROP_TABLE_I F_EXI STS [$$ FCTTBL [ ] _T IN ] 
$$DDL_END 

— #BLOCK_END# RemoveOutput 

/★it****************************************************************/ 

— Set join order for SQL Server 

/*************+****************************************************/ 
~#BLOCK_BEGIN# ForcePlanOn 
$$SQLSERVER[SET FORCEPLAN ON] 
— #BLOCK_END# ForcePlanOn 

— Remove stuff already in fact table 

Note that currently this filter implies that once a transactional 

— fact entry is made it cannot be changed - and no further fact 

— entries on that date or any previous date can be made either 

/*************************★******+************************************************/ 

— #BLOCK_BEGIN# CreateTIN 

$ $ SELECT_I NTO_BEGIN [ $ $ FCTTBL [3 _TIN] 

SELECT 
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s. iss, 

s .ss_key, 

s.date_key, 

s. trans type_key, 

s.ikey seq 

s.$$DIMKEYR_01 

s.$$DIMKEYR_02 

s.$$DIMKEYR_03 

s.$$DIMKEYR_04 

s.$$DIMKEYR_05 

s.$$DIMKEYR_06 

S.$$DIMKEYR_07 

S.$$DIMKEYR_08 

s.$$DIMKEYR_09 

S.$$DIMKEYR_10 

s.$$DEGKEY__01 

S.$$DEGKEY__02 

S.$$DEGKEY_03 

s.$$FCTCOL_001 

S.$$FCTCOL_002 

s.$$FCTCOL_003 

s.$$FCTCOL_004 

s.$$FCTCOL__005 

s.$$FCTCOL_006 
, s.$$FCTCOL_007 

S.$$FCTCOL_008 

s.$$FCTCOL_009 
, s.$$FCTCOL_010 

S.$$FCTCOL__011 

s.$$FCTC0L_012 

s.$$FCTCOL_013 

S.$$FCTCOL_014 

S.$$FCTCOL 015 
, s.$$FCTCOlT016 

s.$$FCTC0LJ)17 

s.$$FCTCOL 018 

s.$$FCTCOlT019 
, S.S$FCTCOL_020 

S.$$FCTCOL_021 

s.$$FCTCOL__022 

S.$$FCTCOL_023 
, S.$$FCTCOL_024 

$$SELECT_INTO_BODY [ $$FCTTBL [ ] _TIN] 
FROM 

$ $ FSTGTBL [ ] _MAP s, bus_process b 

WHERE 

NOT EXISTS (SELECT * FROM $$FCTTBL [ ] $$CURR f WHERE 
s.iss = f.iss AND 
s.ss_key =» f.ss_key AND 
f.datejcey >- s.datejcey) 



AND 


( 












(s. 


$$FCTCOL 


001 


<> 


0 


OR 


(s. 


$$fctcol" 


"002 


<> 


0 


OR 


(s 


$$fctcol~ 


"003 


<> 


0 


OR 


(s 


$$fctcol" 


'004 


<> 


0 


OR 


(s 


$$fctcol" 


"005 


<> 


0 


OR 


(s 


$$fctcol" 


'006 


<> 


0 


OR 


(s 


$$fctcol" 


"007 


<> 


0 


OR 


(S.$$FCTCOL 


"008 


<> 


0 


OR 


(s 


$$fctcol 


'009 


<> 


0 


OR 


(s 


$$fctcol" 


"010 


<> 


0 


OR 


(s 


$$fctcol" 


"Oil 


<> 


0 


OR 


(S 


$$fctcol" 


"012 


<> 


0 


OR 


(s 


$$fctcol" 


"013 


<> 


0 


OR 


(S 


$$fctcol" 


"014 


<> 


0 


OR 


(S 


$$fctcol" 


"015 


<> 


0 


OR 


(s 


$$fctcol" 


"016 


<> 


0 


OR 


(S 


$$fctcol" 


"017 


<> 


0 


OR 


(s 


,$$fctcol" 


"018 


<> 


0 



Method and Apparatus for Creating a Well- PATENT Inventors: Craig D. Weissman, 

Formed Database System Using a Computer Page 122 Greg V. Walsh and Eliot L. Wegbreit 

Attorney Docket No. 20308.710 
C:\NRPORTBL\PALibi\acw\1058393.1 



OR 


(s 


$$FCTCOL 


019 


<> 


O) 


OR 


(s 


$$FCTCOL 


"020 


<> 


O) 


OR 


(s 


$$FCTCOL~ 


"021 


<> 


0) 


OR 


(S 


$$fctcol" 


"022 


<> 


0) 


OR 


(S 


$$fctcol" 


'023 


<> 


0) 


OR 


(S 


$$fctcol" 


'024 


<> 


0) 


AND 


) 











s .process_key = b. process_key AND b.process_name = 'LoadTrans' 
— # BLOCK_END# CreateTIN 

/******************************************************************/ 

— Set join order for SQL Server 

/a*****************************************************************/ 
— #BLOCK_BEGIN# ForcePlanOff 
$$SQLSERVER[SET FORCE PLAN OFF] 
— #BLOCK_END# ForcePlanOff 

/**★***************************★**************+***********************************/ 

— CR158: We want to load _TMI table and still keep the non-descending 

— order so that the clustered index on a fact table can be created 

— without sorting. This way can speed up significantly in creating a 

— clustered index on a very large already sorted fact table. 

/***************************************************** ********************** ****** / 

— #BLOCK_BEGIN# CreateTMI 

$$SELECT_INTO_BEGIN ( $$FCTTBL [ ] _TMI ] 
SELECT 

* 

$$SELECT_INTO_BODY [ $$FCTTBL [ ] __TMI ] 
FROM 

$$FCTTBL[] $$CURR 

WHERE 

datejcey >= (SELECT MAX (date_key) FROM $$FCTTBL[ ]_TIN) 
UNION ALL 
SELECT 

* 

FROM 

$$FCTTBL[] TIN 
$$SQLSERVER [ORDER "BY 

date_key 
, $$DIMKEYR_01 
, $$DIMKEYR_02 
, $$DIMKEYR_03 

$$DIMKEYR_04 

$$DIMKEYR_05 

$$DIMKEYR_06 
, $$DIMKEYR_07 

$$DIMKEYR_08 

$$DIMKEYR_09 

$$DIMKEYR_10 

] 

— #BLOCK_END# CreateTMI 

/*********************************************************************************/ 

— Insert everything into the new fact table 

/*********************************************************************************/ 
— # BLOCK_BEGIN # CreateTXN 

$ $ SELECT_INTO_BEGIN [ $ $ FCTTBL [ ] _TXN ] 
SELECT 

* 

$$SELECT_INTO_BODY [ $$FCTTBL [ ]_TXN] 

FROM 
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$$FCTTBL [ ] $$CURR S 
WHERE s.date key < (SELECT MAX (date key) FROM $$FCTTBL[] TIN) 
UNION ALL 
SELECT 

* 




FROM 

$$FCTTBL( ] TMI f 




— #BLOCK END# CreateTXN 




/****** *************************************************************************** ^ 




Count inserted data and put results into communication table 
/**************************************** ********* ********************************/ 




itRT.OrK RRfiTNil ^PRp^nl t*«; 




BEGIN 




*TN^1*!RT TMTO flriAiTif i vp 1~ pmn 1 ^ t" p nrnf 1 1 P ft"Okpn namp rnimriPT" rnu<; \ 
SELECT ' PROCESSED* # COUNT (1) FROM $$FSTGTBL [T_MAP$$EOS 




INSERT INTO adaptive_template_prof ile (token_name, number_rows) 

^PT.PrT ' TN^FRTFIV POTTNT t 1 \ FROM SSFrTTRT.M TTNfiSFn^ 

0£jJLt£)V-r X X ilOHirVX EiU / \J \J Vi X \ J. f £ I\Ut X y yl V^l x D14 [ J liny y Ej wO 








— 4BL0CK END# SPResults 




IT X CiUltr Iini Ci CjlNUff lOaU UXTailo 




— # TEMPLATE_BEG I N # index_fact 




/**************************************************************************** * * ******* 


/ 


— Copyright * 1997, Epiphany Marketing Software, Inc. All Rights Reserved. 




— Post processing after an extraction run 




— Reindex fact tables 

— CR1S8: added with SORTED_data in creating cluster index on tact table 




XVCXIIUVC Oily l> CIll^J CQJJXCu ^CllCLaLCU UUllli^ CALL Cl\~ L1UJ1 




/************************************************************************************* 


/ 


/************************************************************************************* 


/ 


— — Pri ma t~ \r Vpv i nripv t"hp fart - t" shl p 

/************************************************************************************* 


/ 


--#BLOCK_BEGIN# PKIndexFact 




$$DDL~EXEC[ 




CREATE UNIQUE INDEX XPK$$FCTTBL [ ] $$NEXT ON $$FCTTBL [ ] $$NEXT 




( 

iss ; ss_key , date_key , transtype_key , seq 

) 




] 

ssnriL end 




— # BLOCK_END# PKIndexFact 




/************************************************************************************* 


/ 


— Inversion index the fact table 

/** ************************************** *************************** ****************** 


/ 


— #BLOCK_BEGIN# IEIndexFact 




$$DDL BEGIN 
$$DDL EXEC[ 
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CREATE $ $ SQLSERVER [ CLUSTERED ] INDEX XIEK$$FCTTBL [ ] $$NEXT ON S$FCTTBL [ ] $$NEXT 
( 

date_key 
$$DIMKEYR_01 
$$DIMKEYR_02 
$$DIMKEYR_03 
$$DIMKEYR_04 
$$DIMKEYR_05 
$$DIMKEYR_06 
$$DIMKEYR_07 
$$DIMKEYR_08 
$$DIMKEYR_09 
, $$DIMKEYR_10 
) $$SQLSERVER[WITH SORTED_DATA] 

] 

$$DDL_END 

— #BLOCK_END# IEIndexFact 

/**+★**★** ***************************************+*************************+**+ *******/ 

— Remove any mapped tables 

/******************★*********************************** **************************+****/ 

— #BLOCK_BEGIN# RemoveTemps 

$$DDL_BEGIN 

$ $ DRO P_T ABLE_ I F_EX I STS t $ $ FST GTBL [ ] _MAP ] 
$$DDL_END 

— #BLOCK_END# RemoveTemps 

— #TEMPLATE_END# index_fact 
— #TEMPLATE_BEGIN# ren_trans 

/**********************★*********★**+**+********************************/ 

— Copyright * 1997, Epiphany Marketing Software, Inc. All Rights Reserved. 

— ren_ trans 

— Epiphany Marketing Software, 1997 

— Simply change the name of the transaction new table to the 

— actual fact table name - used for Fact tables that don't have 

— any stored procedure other than load_trans attached to them 

/**********************************************+*+********+*************/ 

/*****************★****************************************************+/ 

— Delete the output tables 

/*****************★*********+*******************************************/ 

— #BLOCK_BEGIN# RemoveOutput 

$$DDL_BEGIN 

$ $ DROP_TABLE_I F_EXI STS [ $$ FCTTBL [ ] $ $NEXT ] 
$$DROP_TABLE_IF_EXISTS [$$ FCTTBL [ ] _INC] 
$$DDL_END 

— #BLOCK__END# RemoveOutput 

/*****************+******+**********************************************/ 

— Move all transaction rows into the correct new fact table 
~ name. Note that we would use sp_rename, except it 

— doesn't work with DB name prefixes 

— TBD: Rename instead of re-select 

/**********************+****+****★******+*********************+*********/ 

Inventors: Craig D. Weissman, 
Greg V. Walsh and Eliot L. Wegbreit 
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--#BLOCK_BEGIN# BuildNewFact 

$$SELECT_INTO_BEGIN [$$ FCTTBL [ ] $$NEXT] 
SELECT 

* 

$ $SELECT_I NT0_B0DY ( $ $ FCTTBL [ ] $ $NEXT ] 
FROM 

$$FCTTBL[]_TXN 
--#BLOCK_END# BuildNewFact 

/**************************************** 

— Preserve incremental table 
/************************************+***** 

--#BLOCK_BEGIN# Buildlncremental 

$ $ SELECT_I NTO_BEGIN [ $ $ FCTTBL [ ] _INC ] 
SELECT 

$ $ SELECT_I NTO_BODY [ $ $ FCTTBL [ ] _INC ] 
FROM 

$$FCTTBL[]_TIN 
--#BLOCK_END# Buildlncremental 

/*******•****************** + ***************** + ***************************/ 

— Count inserted data and put results into communication table 
Z*********************************************** ************************/ 

--#BLOCK_BEGIN# SPResults 
BEGIN 

INSERT INTO adaptive_template_prof ile (token_name, number_rows) 
SELECT 'PROCESSED 1 , COUNT (I) FROM $$ FCTTBL []_TXN$ $ EOS 

INSERT INTO adaptive_template_prof ile (token_name, number_rows) 
SELECT 'INSERTED' , COUNT(l) FROM $$FCTTBL [ ] _TXN$$EOS 

END$$EOS 

--#BLOCK_END# SPResults 

/****** + ****■****** + *****************•*****★**** *■*************************/ 

— Remove temp tables 

/********+************************★*★***********************+***********/ 

--#BLOCK__BEGIN# RemoveTemps 

$$DDL_BEGIN 

$ $ DROP _TABLE_I F_EXI STS [ $ $ FCTTBL [ ] _TXN ] 
$ $ DROP_TABLE I F_EXI STS [ $ $ FCTTBL [ ] _T IN ] 
$ $ DROP_TABLE JC F_EXI STS t $ $ FCTTBL [ ] _TMI ] 
$ $ DDL_END 

- - # BLOCK_END# RemoveTemps 
--#TEMPLATE_END# ren_trans 

— #TEMPLATE_BEGIN# map_keys 
/*********★*******************★***★**********+*******+*************/ 

— Copyright * 1997, Epiphany Marketing Software, Inc. All Rights Reserved. 
map_keys 

— Epiphany Marketing Software 
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— Map dimension keys from Staging table and report 


— on unjoined rows 




/**************************************^ 


/**************************************** 


— Remove output table 




/******************************************* 


— #BLOCK_BEGIN# DropTemp 




$$DDL BEGIN 




$$DROP TABLE IF EXISTS [ $$FSTGTBL [ ] MAP] 


$$DDL_END 




— #BLOCK_END# DropTemp 




/********************************************************* 


— Set join order for SQL Server 


/★★a********************************** 


— #BLOCK_BEGIN# ForcePlanOn 


$$ SQLSERVER t SET FORCE PLAN ON] 


— #BLOCK_END# ForcePlanOn 


/************★**************** *******^ 


— Map dimension keys via Inner joins 


/***************************** *********** **************************/ 


— #BLOCK_BEGIN# MapAll 




$$SELECT INTO BEGIN [$$FSTGTBL[ ]_MAP] 


SELECT 




s. iss , 




s. ss_key, 




s . date_key, 




s . transtype_key, 




s. ikey, 




s. process key 




, $$PIPE_STATE 




, m 04.$$DIMKEY 04 


$$DIMKEYR 04 


m 03.$$DIMKEY 03 


$$DIMKEYR 03 


m 06.$$DIMKEY 06 


$$DIMKEYR 06 


m 02.$$DIMKEY 02 


$$DIMKEYR 02 


, m 08.$$DIMKEY 08 


$$DIMKEYR 08 


m 05.$$DIMKEY 05 


$$DIMKEYR 05 


, m 09.$$DIMKEY~09 


$$DIMKEYR 09 


m 01.$$DIMKEY 01 


$$DIMKEYR 01 


, m 07.$$DIMKEY 07 


$$DIMKEYR 07 


ro_10.$$DIMKEY_10 


$$DIMKEYR 10 


$$DEGKEY 03 




$$DEGKEY 02 




$$DEGKEY_01 




s.$$FCTCOL 001 




S.$$FCTCOL 002 




s.$$FCTCOL 003 




S.$$FCTC0L 004 




, s.$$FCTCOL 005 




, s.$$FCTCOL 006 




S.$$FCTCOL 007 




, s.$$FCTCOL 008 




s.$$FCTCOL 009 




s.$$FCTCOL 010 




, s.$$FCTCOL 011 




s.$$FCTCOL 012 




S.$$FCTCOL 013 
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S.$$FCTCOL_014 
s.$$FCTCOL_015 
s.$$FCTCOL_016 
S.$$FCTCOL_017 
s.$$FCTCOL_018 
S.$$FCTCOL_019 
s.$$FCTCOL_020 
s.$$FCTCOL_021 
s.$$FCTCOL_022 
S.$$FCTCOL_023 
s.$$FCTCOL_024 

$ $SELECT_INTO_BODY [ $$FSTGTBL [ 3 _MAP] 
FROM 

$$FSTGTBL [ ] S 

$$MAPTBL_04$$NEXT m_04 $$SQLSERVER[ (index 
$$MAPTBL_03$$NEXT m_03 $$SQLSERVER[ (index 
$$MAPTBL_0 6$$NEXT m_06 $$SQLSERVER[ (index 
$$MAPTBL_02$$NEXT m_02 $$ SQLSERVER [ (index 
$$MAPTBL_08$$NEXT m_08 $$SQLSERVER[ (index 
$$MAPTBL_05$$NEXT m_05 $$SQLSERVER[ (index 
$$MAPTBL_09$$NEXT m_09 $$SQLSERVER[ (index 
$$MAPTBL_01$$NEXT m_01 $$SQLSERVER[ (index 
$$MAPTBL_07$$NEXT m_07 $$SQLSERVER[ (index 
$$MAPTBL 10$$NEXT m_10 $$SQLSERVER[ (index 



1=1 

m_04.iss = s.iss AND m_04 . $$DSTGKEY_04 « s . $$DSTGKEYR_04 

m_03.iss «= s.iss AND m_03 . $$DSTGKEY_03 - s . $$DSTGKEYR_03 

m_06.iss « s.iss AND m_06. $$DSTGKEY_06 = s . $$DSTGKEYR_06 

ra_02.iss = s.iss AND m_02 . $$DSTGKEY_02 - s . $ $DSTGKEYR_02 

m_08.iss = s.iss AND m_08 . $$DSTGKEY_08 = s . $$DSTGKEYR_08 

m_05.iss » s.iss AND m_05 . $$DSTGKEY_05 = s . $$DSTGKEYR_05 

m_09.iss « s.iss AND m_09.$$DSTGKEY_09 = s . $$DSTGKEYR_09 

m_01.iss « S.iss AND m_01 . $$DSTGKEY_01 - s . $ $ DSTGKEYR_0 1 

m_07.iss « s.iss AND m_07 . $$DSTGKEY_07 = s . $$DSTGKEYR_07 

m_10.iss «= s.iss AND inJLO . $$DSTGKEY_10 - s . $$DSTGKEYR_10 

— #BLOCK_END# MapAll 

/****************■********************★*★*****★******************* + + / 

— Set join order for SQL Server 

/**★***********************************+***************************/ 
— #BL0CK_BEGIN# ForcePlanOff 
$$SQLSERVER[SET FORCEPLAN OFF] 
~#BLOCK_END# ForcePlanOff 

/***************+**************************************************/ 

— Look for unjoined data, Report on processed rows 
/**********************★*******************************************/ 



WHERE 
AND 
AND 

Q AND 
'% AND 
AND 

IJl AND 
™ i AND 
iy AND 
!il AND 
i*r= AND 



— #BL0CK__BEGIN# SPResults 
$$DECLARE_BEGIN 

$ $ DEC L ARE_BOD Y [ $ $ VAR t un j oined] $ $EPI INT ] 
$$DECLARE_BODY[$$VAR[processed] $$EPIINT] 

BEGIN 



$$VAR_ASSIGN_BEGIN [processed] 
SELECT COUNT (1) 
$$VAR_ASSIGN_INTO [processed] 
FROM $$FSTGTBL[] 
$$VAR_ASSIGN_END 

$$VAR_ASSIGN_BEGIN [unjoined] 
SELECT $$VAR [processed] - COUNT (1) 
$$VAR ASSIGN INTO [unjoined] 



Method and Apparatus for Creating a Well- PATENT Inventors: Craig D. Weissman, 

Formed Database System Using a Computer Page 128 Greg V. Walsh and Eliot L. Wegbreit 

Attorney DocketNo. 20308.710 
C:\NRPORTBL\PALib lWw\l 058393. 1 



FROM $$FSTGTBL[]_MAP 
$$VAR_ASSIGN_END 

INSERT INTO adaptive_template_prof ile (token_name, number_rows) 
SELECT ' UNJOINED* , $$VAR [unjoined] $$NO_FROM_LIST$ $EOS 

INSERT INTO adaptive_template_prof ile ( token_name, number_rows) 
SELECT ' PROCESSED' , $$VAR [processed] $$NO_FROM_LIST$$EOS 

INSERT INTO adaptive_template_prof ile { token_name, number_rows) 

SELECT 'INSERTED', $$VAR [processed] - $$VAR[unjoined] $$NO_FROM_LIST$$EOS 

END$$EOS 

- - # BLOCK_END# SPResultS 

/************** ************************ ****************************/ 

— Index this temp table 

/******************************************************* ***********/ 
--#BLOCK_BEGIN# IndexMap 

$$DDL_BEGIN 
$$DDL_EXEC[ 

CREATE INDEX X$$FSTGTBL [ 3 _MAP ON $ $ FSTGTBL [ ] _MAP 
( 

iss, ss_key, date_key, ikey 

) 
] 

$$DDL_END 

~#BLOCK_END# IndexMap 

— # T EMPLAT E__EN D # mapjceys 
— # TEMPLATE^ BEGIN # upd_unj 

/★★it******************************************************************/ 

— Copyright * 1997, Epiphany Marketing Software, Inc. All Rights Reserved 

— upd_unj 

Epiphany Marketing Software 

— Update all dimension keys to 1 UNKNOWN ' in staging table 

— where referential integrity fails 

/*******************★********************★****************************/ 

/******+*****************+****+*************************** * *★*★★******/ 

— Count the number of rows to update in the staging table - that is, those 

— that have at least one Foreign key where referential integrity fails 
/★★★★★it***************************************************************/ 

— #BLOCK_BEGIN# CountUnj 
BEGIN 

INSERT INTO adaptive tempi ate_prof ile (token_name, number_rows) 
SELECT 'PROCESSED', COUNT ( 1 ) FROM $$FSTGTBL [ ] $$EOS 

INSERT INTO adapt ive_templ at e_prof ile (token_name, number_rows) 

SELECT 'MODIFIED', COUNT(l) 

FROM 

$$FSTGTBL[] s 

WHERE 1=0 . 

OR NOT EXISTS (SELECT 1 FROM $$MAPTBL_04$$NEXT m_04 WHERE m_04.iss = s.iss AND 
m_04 .$$DSTGKEY_04 = $$DSTGKEYR_04 ) 

OR NOT EXISTS (SELECT 1 FROM $$MAPTBL_03$$NEXT m_03 WHERE m_03.iss = s.iss AND 
m_03.$$DSTGKEY_03 = $$DSTGKEYR_03 ) 

OR NOT EXISTS (SELECT 1 FROM $$MAPTBL 06$$NEXT m 06 WHERE m 06. iss = s.iss AND 
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m_06.$$DSTGKEY_06 = $ $ DSTGKEYR_0 6 ) 

OR NOT EXISTS (SELECT 1 FROM $$MAPTBL_02$$NEXT m_02 WHERE m_02.iss = s.iss AND 
m_02.$$DSTGKEY_02 - $$DSTGKEYR_02 ) 

OR NOT EXISTS (SELECT 1 FROM $$MAPTBL_08$$NEXT m_08 WHERE m_08.iss = S.iss AND 
m_08.$$DSTGKEY_08 *= $$ DSTGKE YR_0 8 ) 

OR NOT EXISTS (SELECT 1 FROM $$MAPTBL_05$$NEXT m_05 WHERE m_05.iss = S.iss AND 
m_05.$$DSTGKEY_05 « $$DSTGKEYR_05) 

OR NOT EXISTS (SELECT 1 FROM $$MAPTBL_09$$NEXT m_09 WHERE m_09.iss = s.iss AND 
m_09.$$DSTGKEY_09 = $$DSTGKEYR_09 ) 

OR NOT EXISTS (SELECT 1 FROM $$MAPTBL_01$$NEXT m_01 WHERE mJH.iss « s.iss AND 
m_0L.$$DSTGKEY_01 = $$DSTGKE^R_01 ) 

OR NOT EXISTS (SELECT 1 FROM $$MAPTBL_07$$NEXT m_07 WHERE m_07.iss = s.iss AND 
m_07.$$DSTGKEY_07 = $$DSTGKEYR_07 ) 

OR NOT EXISTS (SELECT 1 FROM $$MAPTBL_10$$NEXT m_10 WHERE m_10.iss «= s.iss AND 

m 10.$$DSTGKEY_10 = $ $ DSTGKE YR_1 0 ) 

$$EOS 

END$$EOS 

--#BLOCK_END# CountUnj 

/***********+******************************** *************************/ 

— Update foreign keys where referential integrity fails 
/a***************** *•************★**★*************★★****★** + *****★**•***/ 

— #BLOCK_BEGIN# UpdateUn j $ $ DSTGKE YR_0 4 

UPDATE $$FSTGTBL[] SET $ $ DSTGKE YR_0 4 = ' UNKNOWN 1 
WHERE NOT EXISTS (SELECT 1 FROM $$MAPTBL_04$$NEXT m 

WHERE m.iss = $$FSTGTBL [ ] . iss AND m. $$ DSTGKE Y_0 4 « $$FSTGTBL[] . $$DSTGKEYR_04 ) 

--#BLOCK_END# UpdateUn j $$DSTGKEYR_0 4 

— #BLOCK_BEGIN# UpdateUn j $$DSTGKEYR_0 3 

UPDATE $$FSTGTBL[] SET $ $ DSTGKE YR_0 3 = ' UNKNOWN ' 
WHERE NOT EXISTS (SELECT 1 FROM $$MAPTBL_03$$NEXT m 

WHERE m.iss - $$FSTGTBL [ ] . iss AND m. $$ DSTGKE Y_0 3 = $$FSTGTBL[ ] . $$ DSTGKE YR_0 3) 

— # BLOCK_EN D # UpdateUn j $$DSTGKEYR_03 

— #BLOCK_BEGIN# UpdateUn j $$DSTGKEYR_06 

UPDATE. $$FSTGTBL[ ] SET $ $ DSTGKEYR_0 6 » ' UNKNOWN ' 
WHERE NOT EXISTS (SELECT 1 FROM $$MAPTBL_06$$NEXT m 

WHERE m.iss = $$FSTGTBL{] .iss AND m. $$ DSTGKE Y_0 6 = $$FSTGTBL [ ] . $$ DSTGKE YR_0 6) . 

--#BLOCK_END# UpdateUn j $$DSTGKEYR_0 6 

— #BLOCK_BEGIN# UpdateUn j $$DSTGKEYR_02 

UPDATE $$FSTGTBL[] SET $ $ DSTGKE YR_0 2 = ? UNKNOWN ' 
WHERE NOT EXISTS (SELECT 1 FROM $$MAPTBL_02$$NEXT m 

WHERE m.iss = $$FSTGTBL [ ] . iss AND m . $ $ DSTGKE Y_0 2 = $$FSTGTBL [.] . $$DSTGKEYR_02) 

— # BLOCK_END# Upda t eUn j $ $ DSTGKEYR_02 

—#BLOCK_BEGIN# UpdateUn j $$DSTGKEYR_08 

UPDATE $$FSTGTBL[] SET $ $ DSTGKEYR_0 8 - 1 UNKNOWN ' 
WHERE NOT EXISTS (SELECT 1 FROM $$MAPTBL_08$$NEXT m 

WHERE m.iss = $$FSTGTBL [ ] . iss AND m. $$DSTGKEY_08 = $$FSTGTBL [ ] . $$DSTGKEYR_08) 

— #BLOCK__END# UpdateUn j $$DSTGKEYR_08 

— #BLOCK__BEGIN# UpdateUnj $$ DSTGKE YR_0 5 

UPDATE $$FSTGTBL[] SET $$DSTGKEYR_05 «= ' UNKNOWN 1 
WHERE NOT EXISTS (SELECT 1 FROM $$MAPTBL_05$$NEXT m 

WHERE m.iss = $$FSTGTBL [ ] . iss AND m. $$ DSTGKE Y_0 5 « $$FSTGTBL[ ] . $$ DSTGKE YR_0 5) 
— #BLOCK END# UpdateUn j $$DSTGKEYR 05 
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% » 



--#BLOCK_BEGIN# UpdateUn j $$DSTGKEYR_09 




UPDATE $$FSTGTBL[] SET $$DSTGKEYR 09 «= ' UNKNOWN ' 
WHERE NOT EXISTS (SELECT 1 FROM $$MAPTBL 09$$NEXT m 

WHERE m.iss = $$FSTGTBL I ] . iss AND m. $$DSTGKEY_09 = $$FSTGTBL [ ] . $$DSTGKEYR_ 


09) 


— #BLOCK_END# UpdateUn j $$DSTGKEYR_09 




--#BLOCK_BEGIN# UpdateUn j $$DSTGKEYR_01 




UPDATE $$FSTGTBL[ ] SET $$DSTGKEYR 01 = 1 UNKNOWN' 
WHERE NOT EXISTS (SELECT 1 FROM $$MAPTBL 01$$NEXT m 

WHERE m.iss = $$FSTGTBL ( ] . iss AND m. $$DSTGKEY_01 « $$FSTGTBL [ ) . $$DSTGKEYR_ 


_01) 


— #BLOCK_END# UpdateUn j $$DSTGKEYR_01 




~#BLOCK_BEGIN# UpdateUn j $$DSTGKEYR_07 




UPDATE $$FSTGTBL[] SET $$DSTGKEYR 07 = 1 UNKNOWN ' 
WHERE NOT EXISTS (SELECT 1 FROM $$MAPTBL 07$$NEXT m 

WHERE m.iss = $$FSTGTBL [ ] . iss* AND m. $$DSTGKEY_07 « $$FSTGTBL [ ] . $$DSTGKEYR_ 


_07) 


— #BLOCK_END# UpdateUn j $$DSTGKEYR_07 




- - #BLOCK_BEGIN# Upda t eUn j $ $ DSTGKE YR_1 0 




UPDATE $$FSTGTBL [ } SET $$DSTGKEYR 10 - ' UNKNOWN ' 
WHERE NOT EXISTS (SELECT 1 FROM $$MAPTBL 10$$NEXT m 

WHERE m.iss = $$FSTGTBL [ ] . iss AND m. $$DSTGKEY_10 - $ $ FSTGTBL [ ] . $ $ DSTGKE YR_ 


_10) 


— #BLOCK_END# UpdateUn j $$DSTGKEYR_10 




— #TEMPLATE_END# ' upd_unj 





The following are the post-parsed SQL source for the adaptive templates as filled in with 
corresponding schema definitions. 



— #TEMPLATE_BEGIN# force_close 
/**************************★********************** 

— Copyright * 1997, Epiphany Marketing Software, Inc. All Rights Reserved. 

— force_close 

— Close out deleted orders - those that no longer appear in the 

— staging table 

~ SEE SAFETY VALVE BELOW 

/****************************************^ 
/************★******************************* 

— Delete temporary tables 
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% 



/**********************************************************************************^ 
--#BLOCK_BEGIN# DropTemps 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id = object_id( 'dbo.OrderJ^FC ) AND sysstat & Oxf 
3) DROP TABLE Order_0_FC 

- - # BLOCK_EN D# DropTemps 

/**********************************************************************************/ 

— Insert negative BOOKs for deleted orders 

— FC: ForceClose 

/******************************************************** ************************** / 
~#BLOCK BEGIN# MakeFC 



*0 

in 



hi 



3 y 



SELECT 

f . iss, 
f . ss_key, 

MAX (f . date_key) date_key, 
MIN(f . trans type_key) transtype_key, 
MAX(f.seq) + 1 seq 
f . customerbillto_key 
f ,product_key 
f . application_key 
f . program_key 
f . customershipto_key 
f . territory_key 
f . warehouse_key 

-SUM ( f . net_price ) net_price 
-SUM { f . number_units ) number_unit s 

INTO Order_0_FC 
FROM 

Order_0_A f 

WHERE 

NOT EXISTS 

{SELECT 1 FROM OrderStage_MAP s WHERE s.iss = f.iss AND s.ss_key » f.ssjcey) 
GROUP BY 

f.iss, 
f.ss_key 

f . customerbillto_key 
f . product_key 
f . application_key 
f . program_key 
f . customershipto_key 
f . territory_key 
f . warehouse_key 



HAVING 



OR 



(SUM(f .net_price) <> 0) 
(SUM(f .number units) <> 0) 



AND 

MIN ( f . transtype_key ) <« 99 

AND 

MIN (f . trans typejcey) >= 1 
— #BLOCK_END# MakeFC 

/**********************************************************************************/ 

— SAFETY VALVE - THIS PROC ONLY DOES ANYTHING 

— IF THE STAGING TABLE HAS AT LEAST ONE ROW 

/A*********************************************************************************/ 



Method and Apparatus for Creating a Well- PATENT Inventors: Craig D. Weissman, 

Formed Database System Using a Computer Page 1 32 Greg V. Walsh and Eliot L. Wegbreit 

Attorney Docket No. 20308.710 
C:VNRPORTBL\PALibl\acwM 058393.1 



— #BLOCK_BEGIN# SafetyValue 
DECLARE @count_MAP INT 
BEGIN 

SELECT @count_MAP = ( 
SELECT COUNT (1) 

FROM OrderStage_MAP 
) 

IF ( (@count_MAP = 0) ) 
DELETE FROM Order_0_FC 



END 

— #BLOCK_END# SafetyValue 

y************************************* **************************************** *****/ 
— Count processed, inserted rows 

/**********************************************************************************/ 

— #BLOCK_BEGIN# SPResults 

BEGIN 

INSERT INTO adapt ive_template_profile (token_name, number_rows) 
SELECT * PROCESSED* , COUNT (1) FROM Order_0_A 

INSERT INTO adaptive_template_prof ile (token_name, number_rows) 
SELECT ' INSERTED 1 , COUNT (1) FROM Order_0_FC 

END 

— #BLOCK_END# SPResults 
--#TEMPLATE_END# force_close 



— #TEMPLATE_BEGIN# load_State . 
/★★it********************************************************************************/ 

— Copyright * 1997, Epiphany Marketing Software, Inc. All Rights Reserved. 

— load_state 

— Load order bookings into fact table by creating transactional 

— data from state data 

— load_trans must be run before this procedure to create TIN table 
^**********+****+***+****************^ 

^************+*+********************** 

— Delete temporary tables 

/***********************************************************************************/ 
~#BLOCK_BEGIN# DropTemps 

IF EXISTS {SELECT 1 FROM sysobjects WHERE id = object_id ( 1 dbo . Order_0_MFL* ) AND sysstat & Oxf 
= 3) DROP TABLE Order_0_MFL 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id « object_id ( 1 dbo . Order_0_lST 1 ) AND sysstat & Oxf 
= 3) DROP TABLE Order_0_lST 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id = object_id ( ' dbo . Order_0_IL 1 ) AND sysstat & Oxf - 
3) DROP TABLE Order_0_IL 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id = object_id ( ' dbo . Order_0_IR' ) AND sysstat & Oxf = 
3) DROP TABLE Order 0 IR 
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IF EXISTS (SELECT 1 FROM sysobjects WHERE id = 
= 3) DROP TABLE Order_0_IRD 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id = 
= 3) DROP TABLE Order_0_IND 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id = 
= 3) DROP TABLE Order_0_NFD 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id «= 
= 3) DROP TABLE Order_0_IRM 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id = 
« 3) DROP TABLE Order_0_IDM 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id = 
= 3) DROP TABLE Order_0_ILM 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id = 
= 3) DROP TABLE Order_0_IMI 
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— #BLOCK_END# DropTemps 

/******+**********★** *************************+****+********** *****/ 

— Set join order for SQL Server 

/******************************************************************/ 

— #BLOCK_BEGIN# ForcePlanOn 

SET FORCE PLAN ON 

— #BLOCK_END# ForcePlanOn 

/*****************************************************************************^ 

— Remove rows older than fact table - history can not be rewritten - only 

— the last date for an order can be changed. Note that we compare transtype's 

— because SHIP type transactions might occur at a later date and we don't want 

— those to interfere 

— Also, since the staging table may have multiple entries for a given order on 

— a single day - we assume that the list one inserted in the Staging table will 

— be used (since ikey is an IDENTITY column) 

— Note that a given ss_key must use the same Booking transtype for all of time, 

— otherwise the transtype_key 

— MFL: Mapped Filtered 

/****************** ************************^ 
~#BLOCK BEGIN# MakeMFL 



SELECT 

s.* 

INTO Order_0_MFL 
FROM 

OrderStage_MAP s, busjprocess b 

WHERE 

((s.date_key >= (SELECT MAX (date_key) FROM Order_0_A f WHERE 
s.iss = f.iss AND s.ss_key = f.ss_key AND 
s . transtype_key = f . transtype_key) ) 
OR NOT EXISTS (SELECT * FROM Order_0_A f WHERE 

s.iss = f.iss AND s.ss_key = f.ss_key AND 
s.transtype_key « f. trans type_key) ) 
AND s.ikey = (SELECT MAX (t. ikey) FROM OrderStage_MAP t WHERE 
s.iss ~ t.iss AND 
s.ss_key = t.ss_key AND 
s.date_key = t.date_key AND 
t .process_key «= b.process_key) 

AND 

s.process_key = b. process_key AND b.process_name = 'LoadState' 
— #BLOCK_END# MakeMFL 

/****************************************** 

— Index MFL table for later queries 
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/************************************* ************ + *************★*******************/ 
~#BLOCK_BEGIN# IndexMFL 

EXEC ( ' 

CREATE INDEX XOrder_0_MFL ON Order_0_MFL 
( 

iss, ss_key, date_key 

) 

') 

— #BLOCK_END# IndexMFL 

y* ************* ************************************************ + ********* **★****★+**/ 
Get oldest state rows for each unique sskey 

— We need to treat the first entry for each order 

in the staging table separately from all others, since 
-- only the first entry needs to be compared with 
-- already existing fact entry rows to create transactions. 

— All subsequent dates for that order in the Fact table 

-- can be delta 'd with other staging table entries - see the 

— section below on Pairwise deltas. 

-- MFL should be indexed 

— 1ST: The first record for each iss, ss_key 
/★★★★★♦a******************************************** 

— # BLOCK_BEG I N # MakelST 
SELECT 

s.* 

INTO Order_0_lST 
FROM 

Order_0_MFL s 

WHERE 

s.date_key = (SELECT MIN <date_key) FROM. Order_0_MFL t WHERE 
s.iss = t.iss AND s.ss_key = t.ssjcey) 

— #BLOCK_END# MakelST 

/******************************************** 
~ Index 1ST for later queries 

— #BLOCK_BEGIN# IndexlST 

EXEC ( 1 

CREATE UNIQUE INDEX XPKOrder_0_lST ON Order_0_lST 
( 

iss, ss_key > 

) 

') 

~#BLOCK_END# IndexlST 

/★★★a************************************* *********^ 

— Insert negative BOOKS for changed dim keys 

— This query will add up all existing Books and Loss's 

— for this order and the net facts will be cancelled out 

— with the old Dimension keys. Note that an invariant of this 

— procedure is that only one set of dimensions at a time 

— can have non-zero facts. 
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— Fact table Should be indexed 

— HAVING Clause is needed to prevent changing of dimensions 

— on fully shipped order from causing a transaction - no sense 

— creating fact rows with all zero's in them 

— Note that we increment the sequence number just in case 

— this new transaction occurs on the same date as the last 

— existing one in the fact table - to avoid index errors 

— IL: InsertLost 

/*******************★**************★************************************************/ 
— #BLOCK BEGIN# MakelL 



SELECT 



S. 1SS, 

s. ss_key, 

s. date_key, 

s . transtype_ key , 

MAX(f.seq) + 1 seq 

f . customerbillto_key 

f .product_key 

f . application_key 

f . program_key 

f . customer ship to_key 

f . territory_key 

f . warehouse_key 

-SUM(f .netjprice) net_price 
-SUM(f .number__units) number_units 



INTO Order_0_IL 
FROM 



WHERE 



AND 



ru 



Order_0_lST s, Order_0_A f 

s.iss = f.iss AND s.ss_key = f.ss_key 

( (s.territory_key <> f .territory_key) OR 
(s .customershipto_key <> f . customershipto_key) 
(s.warehousejcey <> f . warehouse_key) OR 
(s.program_key <> f .program_key) OR 
(s.application_key <> f . application_key) OR 
(s.product_key <> f .product_key) OR 
(s.customerbilltojcey <> f . customerbilltojcey) ) 



OR 



GROUP BY 



HAVING 
AND 



OR 



s. 1SS, 

s. ss_key, 

s.date_key, 

s. transtype_key 

f . customerbillto_key 

f .product_key 

f . application_key 

f .program_key 

f . customershipto_key 

f . territory_key 

f . warehouse_key 



MIN (f . transtype_key) » s. trans type_key 



(SUM(f .net_price) <> 0) 
(SUM(f .number^units) <> 0) 

) 



— #BLOCK_END# MakelL 

/***********★*********************************+*************************************/ 
— Index IL for later queries : 
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***#*■*****************************************************+************************/ 



--#BL0CK BEGIN# IndexIL 



EXEC ( ' 

CREATE INDEX XPKOrder_0_IL ON Order_0_IL 
( 

iss, ss_key 

) 



Insert BOOKS for changed dim keys 

— When a dimension changes then just create a booking 

— transaction for whatever we negated above with the new 
dimension and fact values 

— 1ST shoud be indexed 

— Note that we add one to whatever we used as the last 
-- seq because this transaction occurs on the same 

— date as the negative one above 

— IR: Insert Rebook 

/*******************★**************+************************************************/ 
— #BLOCK BEGIN# MakeIR 



s. iss, 

s.ss_key, 

s.date_key, 

1 . transtype_key , 

l.seq + 1 seq 

s . customerbillto_key 

s.product_key 

s . appl i cation_key 

s .program_key 

s . customershipto__key 

s . territory_key 

s . warehouse_key 

-l.net_price net_price 

-1. number units number_units 



INTO Order_0_IR 
FROM 

Order_0_IL 1, Order_0_lST s 
WHERE l.iss <= s.iss AND l.ss_key = s.ss_key 

— #BL0CK_END# MakeIR 

^^* ++ ** + ********++******************************************************************/ 
~ Insert BOOKs for changed dim keys where fact 

— also changed 

— When a dimension changes at the same time as 

— a fact then we need to make up the fact difference 

— 1ST shoud be indexed 

— Note that we add two to whatever we used as the last 

— seq because this transaction occurs on the same 

— date as the negative and positive ones above 



--#BLOCK END# IndexIL 




SELECT 
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% % 



— Note also that the Left Outer join uses transtype_key 

— so that only the Bookings at the old value will be counted. 

— Whereas above for the negative transaction value 

— we want to include Shipments in our calculation, here 

— we only want to see how Booking Facts have changed. 

— Here again, only one Booking transaction type is supported 

— per ss_key 

— IRD: Insert Rebook delta 
/★a***************************************** 

— #BLOCK BEGIN# MakeIRD 



SELECT 

s .iss, 
s.ss_key, 
s .date_key, 
s . trans type_key, 
l.seq + 2 seq 
s . customerbillto_key 
s ,product_key 
s . application_key 
s.program_key 
s . customershipto_key 
s.territory_key 
s . warehouse_key 

MAX(s.netj?rice)-ISNULL(SUM(f .net_price) , 0) net_price 
MAX(s.number_units)-ISNULL{SUM{f .number_units) , 0) number_units 

INTO Order 0_IRD 
FROM 

Order_0_IL 1, Order_0_JLST s 

LEFT OUTER JOIN Order_0_A f ON 
s. transtype_key = f . transtypejcey 
WHERE 

l.iss = s.iss AND l.ss_key = s.ss_key 



s.iss = f.iss AND s.ss_key = f.ss_key AND 



GROUP BY 

s.iss, 
s.ss_key, 
s.date_key, 
s.transtype_key, 
1 . seq 

s . customerbillto_key 
s.product_key 
s . application_key 
s.program_key 
s . customershipto_key 
s.territory_key 
s.warehouse_key 

HAVING 

(ISNULL(SUM(f .net_price) , 0) <> MAX(s .net_price) ) 
OR (ISNULL(SUM(f .number_units) , 0) <> MAX(s.number_units) ) 

~#BLOCK_END# MakeIRD 

/***********************************************************************************/ 

— Insert BOOKs for deltas with same dim keys OR for 

— brand new orders. 

— Note that we DON'T want to count Shipments 

— (so shipment ss_key*s should be different from 

— order ss_keys) since we just want bookings to sum up 

— to whatever this transcation says they should be. 

— Fact table should be indexed 
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— WHERE clause prevents double booking on changed 

— dimension - if we didn't use the NOT EXISTS clause 

— then this query would repeat the work of the last one 

— above - which we have already taken care of 

— HAVING clause ensures that multiple 0 records don't 

— get inserted whenever this procedure is run 

— Note that we increment the sequence number just in case 

— this new transaction occurs on the same date as the last 

— existing one in the fact table - to avoid index errors 

— IND: Insert New Delta 
— #BLOCK_BEGIN# MakeIND 
SELECT 

s . iss, 
s.ss_key, 
s.date_key, 
s . transtype_key, 
ISNULL(MAX(f .seq) , 0) + 1 seq 
s .customerbillto_key 
s .product_key 
s . application_key 
s .program_key 
s . customershipto_key 
s . territory_key 
s . warehouse_key 

MAX(s.net_price) -ISNULL (SUM (f .net_price) , 0) net_price 
MAX (s. numb er_units ) -ISNULL (SUM (f.number_units) , 0) number_units 

INTO Order_0_IND 
FROM 

Order_0_lST s LEFT OUTER JOIN Order_0_A f ON 

s.iss = f.iss AND s.ss_key = f.ss_key AND f. trans type_key <= s . transtype_key 

WHERE 

NOT EXISTS (SELECT * FROM Order_0_IL WHERE iss = s.iss AND ss_key = s.ss_key) 

GROUP BY 

s.iss, 
s.ss_key, 
s.date_key, 
s . transtype_key 
s .customerbillto_key 
s .product_key 
s . application_key 
s . program_key 
s .customer shipto_key 
s . territory_key 
s . warehouse_key 

HAVING 

( ISNULL ( SUM { f . net_price ) ,0) <> MAX (s . net_price) ) 
OR (ISNULL(SUM(f .nuraber_units) , 0) <> MAX (s .number_units) ) 

— #BLOCK_END# MakeIND 

/★★★♦★a************************************** 

— Form pairwise deltas for all rows except earliest for each sskey 

— Each row created in NFD will consist of two sequential entries from the 
staing table. So if N enties for an order exist in MFL (after we have filtered 

— out same-date duplicates) then all the queries above will deal with the earliest entry, 
whereas 

— all the queries below (including this one) will deal with the N-l deltaing transactions 
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— This query assumes that MFL will already have been filtered 

— to have a single record for each order/datekey 

— NFD: Not First Delta 

/***************** ***********************^ 
— #BLOCK_BEGIN# MakeNFD 

SELECT 

s.iss siss, t.iss tiss 
s.ss_key sss_key, t.ss_key tss_key 
s.date_key sdate_key, t.date_key tdate_key 

s.transtype_key stranstype_key, t . transtype_key ttranstype_key 

s .customerbillto_key scustomerbillto_key, t. customerbillto_key tcustomerbillto_key 
s .product_key sproduct_key, t ,product_key tproduct_key 
s .application_key sapplication_key, t . application_key tapplication_key 
s ,program_key sprogram_key, t .program_key tprogram_key 

s ,customershipto_key scustomershipto_key, t . customershipto_key tcustomershipto_key 
s.territory_key sterritoryjcey, t . territory_key tterritoryjcey 
s .warehouse_key swarehouse_key, t . warehouse_key twarehouse_key 
s.net_price snet_price, t.net_price tnet_price 
s ,number_units snumber_units, t . number_units tnumber_units 

INTO Order_0_NFD 
FROM 

Order_0_MFL s, Order_0_MFL t 

WHERE 

s.iss = t.iss AND s.ss_key =* t.ss_key 

AND 

s.date_key = (SELECT MAX (date_key) FROM Order_0_MFL u WHERE 

u.iss = s.iss AND u.ss_key ~ s.ss_key AND u.date_key < t.date_key) 

— #BLOCK_END# MakeNFD 

/************-***-** ****** ************************************************************/ 

— Insert BOOKs for deltas with same dim keys 

— If the dimensions don't change then we create a 

— new booking order (as long as at least one of the facts 

— have changed) 

— I DM: Insert Delta More 

^*************************************** ****** **************************************/ 
— #BLOCK BEGIN# MakelDM 



SELECT 

tiss iss, 
tss_key ss_key, 
tdate_key date_key, 
ttranstype_key transtype_key, 
0 seq 

tcustomerbillto_key customerbillto_key 
tproduct_key product_key 
tapplication_key application_key 
tprograra_key program_key 
tcustomershipto_key customershipto_key 
tterritory_key territory_key 
twarehouse_key warehouse_key 

, tnet_price-snet_price net_price 

, tnumber_units-snumber_units number_units 

INTO Order_0_IDM 
FROM 

Order_0_NFD d 
WHERE 
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: rsj 

Ml 



AND 



OR 



( 

(sterritory_key « tterritoryjcey) AND 
(scustomershipto_key = tcustomershiptojcey) AND 
(swarehouse_key = twarehouse_key) AND 
(sprogram_key = tprogram_key) AND 
(sapplication_key = tapplication_key) AND 
(sproduct_key = tproductjcey) AND 
(scustomerbillto_key = tcustomerbillto_key) 
) 



(snet_price <> tnet_price) 
(snumber_units <> tnumber_units) 



— #BLOCK_END# MakelDM 

^*****************************************************^ 

— Insert negative BOOKs for deltas with different dim keys 

— If one of the dimensions change then we first create a lose transaction for 

— all the previous facts. (Negate all the facts from the earlier of the two 

— transactions) 

-- ILM: Insert Lost More 
--#BLOCK BEGIN# MakeILM 



SELECT 



siss iss, 
sss_key ss_key, 
tdate_key date_key, 
stranstype_key trans typejcey, 
0 seq 

scustomerbillto_key customerbillto_key 
sproduct_key product_key 
sapplication_key application_key 
sprogram_key program_key 
scustomershipto_key customershipto_key 
sterritory_key territory_key 
swarehouse_key warehouse_key . 

-snet_price net_price 
-snumber units number units 



INTO Order_0_ILM 
FROM 



WHERE 



AND 



OR 



Order_0_NFD d 
(' 

(sterritory_key <> tterritory_key) OR 
(scustomershiptojcey <> tcustomershipto_key) OR 
(swarehouse_key <> twarehouse_key) OR 
(sprogram_key <> tprograro_key) OR 
(sapplication_key <> tapplicationjcey) OR 
(sproduct_key <> tproduct_key) OR 
(scustomerbillto_key <> tcustomerbillto_key) 
) 

( 

(snet_price <> 0) 
(snumber_units <> 0) 
) 



— # BLOCK_END# MakeILM 

/+**********************************************************************************/ 
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— Insert BOOKs for deltas with different dim keys 

— When a dimension key changes then we can simply insert all the new facts with the 

— new dimension keys 

— Note that seq ~ 1 here because this is the second transaction on this date for 

— this order. 

r- IRM: Insert Rebook More 

/***★•*■*■******★■** + ***★* ************************* **•**********************★■**** + *******/ 
--#BLOCK BEGIN# MakeIRM 



SELECT 



tiss iss, 
tss_key ss_key, 
tdate_key date_key, 
ttranstype_key transtype_key, 
1 seq 

tcustomerbillto_key customerbillto_key 
tproduct_key product_key 
tapplication_key application_key 
tprogram_key program_key 
tcustomershipto_key customershipto_key 
tterritory_key territory_key 
twarehouse_key warehouse_key 

tnetjprice netjprice 
tnumber units number units 



INTO Order_0_IRM 
FROM 

Order_0_NFD d 

WHERE 



( 

(sterritory_key <> tterritory_key) OR 
(scustomershipto_key <> tcustomershipto_key) OR 
(swarehouse_key <> twarehouse_key) OR 
(sprogram_key <> tprogram_key) OR 
(sapplication_key <> tapplicationjcey) OR 
(sproduct_key <> tproduct_key). OR 
(scustomerbillto_key <> tcustomerbillto_key) 
) 



AMD 



OR 



(tnet_price <> 0) 
(tnumber units <> 0) 



— #BLOCKJEND# MakeIRM 

/*★********************** ************+**+******************* 
— Delete the output tables 

/****************************************★+********** 
— #BLOCK_BEGIN# DropOutput 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id object_id ( ' dbo . Order_0_B * ) AND sysstat & Oxf = 
3) DROP TABLE Order_0_B 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id - object_id ( ' dbo . Order_0_INC ' ) AND sysstat & Oxf 
= 3) DROP TABLE Order 0_INC 



— #BLOCK_END# DropOutput 

/**************************************************************************** 
— Create FC table in case force close was 
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-- not run 

--#BLOCK_BEGIN# MakeFC 
DECLARE @fc_exis.ts INT 



?*5 



SELECT @fc_exists = ( 
SELECT COUNT (1) 

FROM sysobjects 
WHERE 

id = object_id('dbo.Order_0_FC' ) AND sysstat & Oxf = 3 
) 

IF (@fc_exists = 0) 
EXEC { ' 

SELECT 

* 

INTO Order_0_FC 
FROM 

Order_0_A 

WHERE 

1-0 

') 



— #BLOCK_END# MakeFC 

/A************************************************** 
— Create the incremental table 

/★★★★★★★a****************************************** ^ 
— #BLOCK BEGIN # MakeINC 



SELECT 



INTO OrderJ3_INC 
FROM Order_0_TIN UNION 
SELECT * FROM Order_0_ 
SELECT * FROM Order_0_ 
SELECT * FROM Order_0_ 
SELECT * FROM Order_0_ 
SELECT * FROM Order_0__ 
SELECT * FROM Order_0_ 
SELECT * FROM Order_0 
SELECT * FROM OrderjT 

--#BLOCK END# MakeINC 



ALL 
IL UNION ALL 
IR UNION ALL 
IRD UNION ALL 
IND UNION ALL 
IRM UNION ALL 
ILM UNION ALL 
FC UNION ALL 
I DM 



*************************************** ************************************/ 

— CR158: We want to load _IMI table and still keep the non-descending 
order so that the clustered index on a fact table can be created 

— without sorting. This way can speed up significantly in creating a 

— clustered index on a very large already sorted fact table. 

/**********************+************************************************************/ 
--#BLOCK BEGIN# MakelMI 



SELECT 

* 

INTO Order_0_IMI 
FROM Order_0_A 

WHERE date key >= (SELECT MIN(date key) FROM Order 0 INC) 
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UNION ALL 

SELECT * FROM Order_0_INC 
ORDER BY 

date_key 
, customerbillto_key 
, product_key 
, application_key 
, program_key 
, customershipto_key 
, territory_key 
, warehouse_key 



— #BLOCK_END# MakelMI 

,*********************************^ 

— Create the new fact table and incremental table 

— Note that transaction tables must be built before 

— these statements are run 

/************************************************** *************************^ 
~#BLOCK BEGIN# MakeNewFact 



o 

m 
m 
m 
m 

m 

a 

m 
m 
o 
a 



SELECT * 

INTO Order_0_B 

FROM Order_0_A s 

WHERE s.date_key < (SELECT MIN (datejkey) FROM Order_0_INC) 
UNION ALL 

SELECT * FROM Order_0_IMI 
— #BLOCK END# MakeNewFact 



/**************************************** 
— Count processed, inserted rows 



********************************** 



— #BLOCK_BEGIN# SPResults 
DECLARE @cbunt_INC INT 
BEGIN 

SELECT @count_INC = ( 
SELECT COUNT (1) 

FROM Order_0_INC 
) 

INSERT INTO adaptive_templatejprof ile (token_name, number_rows) 
SELECT ' PROCESSED ' , COUNT { 1 ) FROM Order_0_MFL 

INSERT INTO adapt ive_templatej?rof ile (token_name, number_rows) 
SELECT * INSERTED' , @count_INC - COUNT (1) FROM Order_0_TIN 

END 

— #BLOCK END# SPResults 



— Set join order for SQL Server 
/******************************** 

— #BLOCK_BEGIN# ForcePlanOff 

SET FORCE PLAN OFF 

— #BLOCK_END# ForcePlanOff 

/******************************** 
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: : r 

SH 

2^ 



— Drop terap tables and TXN and TIN table 

/*************************************************************************^ 



******** j 



— #BLOCK_BEGIN# DropTempsAf ter 



IF EXISTS (SELECT 1 FROM sysobjects 

= 3) DROP TABLE Order_0_TIN 

IF EXISTS (SELECT 1 FROM sysobjects 

= 3) DROP TABLE Order_0_TMI 

IF EXISTS (SELECT 1 FROM sysobjects 

3) DROP TABLE Order_0_FC 

IF EXISTS (SELECT 1 FROM sysobjects 

= 3) DROP TABLE Order_0_TXN 

IF EXISTS (SELECT 1 FROM sysobjects 

3) DROP TABLE Concat_MFL 

IF EXISTS (SELECT 1 FROM sysobjects 

= 3) DROP TABLE Order_0_lST 

IF EXISTS (SELECT 1 FROM sysobjects 

3) DROP TABLE Order_0_IL 

IF EXISTS (SELECT 1 FROM sysobjects 

3) DROP TABLE Order_0_IR 

IF EXISTS (SELECT 1 FROM sysobjects 

= 3) DROP TABLE Order_0_IRD 

IF EXISTS (SELECT 1 FROM sysobjects 

= 3) DROP TABLE Order_0_IND 

IF EXISTS (SELECT 1 FROM sysobjects 

= 3) DROP TABLE Order_0_NFD 

IF EXISTS (SELECT 1 FROM sysobjects 

= 3) DROP TABLE Order_0_IRM 

IF EXISTS (SELECT 1 FROM sysobjects 

=» 3) DROP TABLE Order_0_IDM 

IF EXISTS (SELECT 1 FROM sysobjects 

« 3) DROP TABLE Order_0_ILM 

IF EXISTS (SELECT 1 FROM sysobjects 

= 3) DROP TABLE Order 0 IMI 



WHERE id = object_id ( ' dbo. Order_0_TIN' ) AND sysstat & Oxf 
WHERE id = object_id ( ' dbo. Order_0_TMI ' ) AND sysstat & Oxf 
WHERE id = object_id( ' dbo.Order_0_FC ) AND sysstat & Oxf = 
WHERE id « object_id ( ' dbo.Order_0_TXN ' ) AND sysstat & Oxf 
WHERE id = object_id( ' dbo.Concat_MFL' ) AND sysstat & Oxf = 
WHERE id « object_id ( ' dbo.Order_0_lST 1 ) AND sysstat & Oxf 
WHERE id = object_id ( 1 dbo. Order_0_IL' ) AND sysstat & Oxf « 
WHERE id = object_id( ' dbo. Order_0_IR' ) AND sysstat & Oxf = 
WHERE id » object_id( , dbo.Order_0_IRD < ) AND sysstat & Oxf 
WHERE id = object_id( ' dbo. Order_0_IND' ) AND sysstat & Oxf 
WHERE id = object_id ( ' dbo. Order_0_NFD' ) AND sysstat & Oxf 
WHERE id » object_id ( ' dbo. Order_0_IRM' ) AND sysstat & Oxf 
WHERE id - objectJLd (' dbo. Order_0_I DM' ) AND sysstat & Oxf 
WHERE id « object_id ( ' dbo.Order_0_ILM' ) AND sysstat & Oxf 
WHERE id = ob ject_id ( ' dbo. Order_0_IMI ' ) AND sysstat & Oxf 



--#BLOCK_END# DropTempsAf ter 

— #TEMPLATE_END# load_state 

— #TEMPLATE_BEGIN# load_trans 

/***************************************★*******+********************* 

Copyright * 1997, Epiphany Marketing Software, Inc. All Rights Reserved. 

— load_trans 

— Move transaction-like staging data into Fact table - create a temp 

— table with TXN extension that has all old rows along with new rows. 

— Also produce a' TIN (TXN INC) table that has only the new rows 

— Note that the new table will also include all existing rows from 
the Fact table. 

/★★★★★★★★A************************************************ *****^ 

/*********************************** ****************** ****************************/ 

— Delete output tables 

— Output table is called TXN and includes old and new rows 

— Also, leave around _TIN as incremental table from this 

— procedure 

— We also create a table called _TMI which contains all the 

— _TIN records plus the records of overlapping period from the 

— old existing fact table. 

/*********************************************** **********^ 
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— #BLOCK_BEGIN# RemoveOutput 



IF EXISTS (SELECT 1 FROM sysobjects WHERE id 
- 3) DROP TABLE Order_0_TXN 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id 
= 3) DROP TABLE Order_0_TMI 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id 
= 3) DROP TABLE Order_0_TIN 



= object_id( * dbo . Order_0_TXN ' ) AND sysstat & Oxf 
= 6bject_id( 'dbo.Order_0_TMI ' ) AND sysstat & Oxf 
» object_id( 'dbo.Order_0_TIN' ) AND sysstat & Oxf 



- - # BLOCK_END# RemoveOutput 

/*************************************+*****★***************★******/ 

— Set join order for SQL Server 

/*****************************★******+*****************************/ 

— #BLOCK_BEGIN# ForcePlanOn 

SET FORCE PLAN ON 

— #BLOCK_END# ForcePlanOn 

/************************************************ **++*****************************/ 

— Remove stuff already in fact table 

— Note that currently this filter implies that once a transactional 

— fact entry is made it cannot be changed - and no further fact 

— entries on that date or any previous date can be made either 
/*********************************** ***************^ 

— #BLOCK BEGINS CreateTIN 



SELECT 

s. iss, 

s.ss_key, 

s.date_key, 

s . transtype_key, 

s.ikey seq 
, s . custbmerbillto_key 

, s.product_key 
, s.application_key 
, s.program_key 
, s . customershipto_key 

, s.territory_key 
, s.warehouse_key 

, s.netjprice 
, s . number_units 

INTO Order_0_TIN 
FROM 

OrderStage_MAP s, bus_process b 

WHERE 

NOT EXISTS (SELECT * FROM Order_0_A f WHERE 
s.iss « f.iss AND 
s.ss_key » f ,ss_key AND 
f.date_key >= s.date_key) 

AND ( 

(s.net_price <> 0) 
OR (s ,number_units <> 0) 
) 

AND 

s.process_key « b.process_Jcey AND b.process__name = 'LoadTrans* 
--#BLOCK_END# CreateTIN 

/it*****************************************************************/ 
— Set join order for SQL Server 

/********************************************************* *********/ 
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--#BLOCK_BEGIN# ForcePlanOff 
SET FORCE PLAN OFF 
--#BLOCK_END# ForcePlanOff 

/*****•************************************** + ** + ****** + * ****** + ******************★/ 

— CR158: We want to load _TMI table and still keep the non-descending 
-- order so that the clustered index on a fact table can be created 

— without sorting. This way can speed up significantly in creating a 

— clustered index on a very large already sorted fact table. 
/*****************************************^ 

— #BLOCK BEGINS CreateTMI 



SELECT 

* 

INTO Order_0_TMI 
FROM 

Order_0_A 

WHERE 

date_key >~ (SELECT MAX (date_key) FROM Order_0_TIN) 
UNION ALL 
SELECT 

* 

FROM 

Order_0_TIN 
ORDER BY 

date_key 
, customerbillto_key 
, product_key 
, application_key 
, program_key 
, customers nipt o_key 

t territory_key 
, warehouse_key 



— # BLOCK_END# CreateTMI 

/****************************************** + ***.*********** 

— Insert everything into the new fact table 
****************************************** 

— #BLOCK BEGINS CreateTXN 



SELECT 

* 

INTO Order_0_TXN 
FROM 

Order_0_A s 

WHERE s.datejcey < (SELECT MAX (date_key) FROM Order_0_TIN) 

UNION ALL 

SELECT 

* 

FROM 

Order_0_TMI f 
- - # BLOCK_EN D# CreateTXN 

^*** *************************************** ***************************************/ 
-- Count inserted data and put results into communication table 

^*** ************************************************************* *****************/ 

— #BLOCK_BEGIN# SPResultS 

BEGIN 
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INSERT INTO adaptive_template_prof ile (token_name, number_rows) 
SELECT ' PROCESSED ' , COUNT (1) FROM OrderStage_MAP 

INSERT INTO adaptive_template_prof ile (token_name, number_rows ) 
SELECT 'INSERTED*, COUNT (1) FROM Order_0_TIN 

END 

— #BLOCK_END# SPResults 

— #TEMPLATE_END# load_trans 

— #TEMPLATE_BEGIN# index_fact 
y * * * ★ **************************************** + ***************** * 

— Copyright * 1997, Epiphany Marketing Software, Inc. All Rights Reserved. 

— Post processing after an extraction run 
— . Reindex fact tables 

— CR158: added WITH SORTED_DATA in creating cluster index on fact table 

— Remove any temp tables generated during the extraction 



/********************* 



******************* ************** *****************************★*/ 



/************************************************+************************************/ 
— Primary key index the fact table 

/****************** ***************************************^ 
— #BLOCK BEGIN# PKIndexFact 



EXEC ( 1 

CREATE UNIQUE INDEX XPKOrder_0_B ON Order_0_B 



iss , ss_key , datejcey , transtype_key , seq 



) 
') 



— #BLOCK_END# PKIndexFact 

/******************************************************************************* 
— Inversion index the fact table 

/*************************************************************************************/ 
— #BLOCK BEGIN# IEIndexFact 



EXEC ( • 

CREATE CLUSTERED INDEX XIEKOrder_0_B ON Order_0_B 
( 

date_key 

customerbillto_key 
product_key 
app 1 i ca t i on_ke y 
program_key 
customershipto_key 
territory_key 
warehouse_key 
) WITH SORTED_DATA 

*) 



--#BLOCK END# IEIndexFact 
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/***+******************+*************************^ 
— Remove any mapped tables 

/*************************************************************************************/ 
--#BLOCK_BEGIN# RemoveTemps 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id = object_id ( ' dbo . OrderStage_MAP' ) AND sysstat & 
Oxf = 3) DROP TABLE Order Stage_MAP 



— #BLOCK_END# RemoveTemps 

— # T EMPLATE_END # index_fact 
— #TEMPLATE_BEGIN# ren_trans 

/*★**************★***********************+******************************/ 

— Copyright * 1997, Epiphany Marketing Software, Inc. All Rights Reserved. 

— ren_trans 

— Epiphany Marketing Software, 1997 

— Simply change the name of the transaction new table to the 

— actual fact table name - used for Fact tables that don't have 

— any stored procedure other than load_trans attached to them 

/************************************************** *********************/ 

/***********************************************************************/ 

— Delete the. output tables 

/*************************★*********************************************/ 
--#BLOCK_BEGIN# RemoveOutput 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id = object_id( 'dbo.Order_0_B' ) AND sysstat & Oxf = 
3) DROP TABLE Order_0_B 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id ,= object_id ( ' dbo . Order_0_INC ' ) AND sysstat & Oxf 
= 3) DROP TABLE Order J)_INC 



— #BLOCK_END# RemoveOutput 

/♦♦★★★it*****************************************************************/ 

— Move all transaction rows into the correct new fact table 

— name. Note that we would use sp_rename, except it 

— doesn't work with DB name prefixes 

— TBD: Rename instead of re-select 

/***************************************************************** ******/ 
--#BLOCK BEGIN# BuildNewFact 



SELECT 

* 

INTO Order_0_B 
FROM 

Order_0_TXN 
— #BLOCK_END# BuildNewFact 

/*****+*****★***★*******************************************************/ 
— Preserve incremental table 

/★it*********************************************************************/ 
--&BLOCK BEGIN# Buildlncremental 
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SELECT 

* 

INTO Order_0_INC 
FROM 

Order_0_TIN 
— #BLOCK_END# Buildlncremental 

/★★♦it*******************************************************************/ 

— Count inserted data and put results into communication table 

******************* *★************★*★**** + **+** + + ************* ******/ 

— #BLOCK_BEGIN# SPResults 
BEGIN 

INSERT INTO adaptive_template_prof ile {token_name, number_rows) 
SELECT 1 PROCESSED ' , COUNT (1) FROM Order_0_TXN 

INSERT INTO adaptive_template_prof ile (token_name, number_rows) 
SELECT ' INSERTED 1 , COUNT (1) FROM Order__0JTXN 

END 

— #BLOCK_END# SPResults 

/***********************************************************************/ 

— Remove temp tables 

^ + * + ********************************************************************/ 
--#BLOCK_BEGIN# RemoveTemps 



IF EXISTS (SELECT 1 FROM sysobjects WHERE id 
« 3) DROP TABLE Order_0_TXN 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id 
■= 3) DROP TABLE Order_0_TIN 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id 
= 3) DROP TABLE Order 0_TMI 



= object_id(.'dbo. Order J)_TXN» ) AND sysstat & Oxf 
= object^dCdbo.Order^TIN 1 ) AND sysstat & Oxf 
= object_id( , dbo.Order_0_TMI , ) AND sysstat & Oxf 



—#BLOCK_END# RemoveTemps 
— #TEMPLATE_END# ren_trans 

--#TEMPLATE_BEGIN# map_keys 
/******************************************************************/ 

— Copyright * 1997, Epiphany Marketing Software, Inc. All Rights Reserved. 

— map_keys 

— Epiphany Marketing Software 

— Map dimension keys from Staging table and report 

— on unjoined rows 

/********★*********************************************************/ 

/******************************************************************/ 

— Remove output table 

/******************************************************************/ 
' — #BLOCK_BEGIN# DropTemp 

IF EXISTS (SELECT 1 FROM sysobjects WHERE id = objected (' dbo. Order St age_MAP ' ) AND sysstat & 
Oxf = 3) DROP TABLE OrderStage_MAP 



Method and Apparatus for Creating a Well- PATENT Inventors: Craig D. Weissman, 

Formed Database System Using a Computer Page 1 50 Greg V. Walsh and Eliot L. Wegbreit 

Attorney Docket No. 20308.710 
C:\NRPORTBL\PALib l\acw\10583 93. 1 



% 



% 



ill 



\n 

Q 
O 



— # BLOCK_END# DropTemp 

/******************************************************************/ 

— Set join order for SQL Server 

/★A****************************************************************/ 

— #BLOCK_BEGIN# ForcePlanOn 

SET FORCE PLAN ON 

— #BLOCK_END# ForcePlanOn 

— Map dimension keys via Inner joins 

/******************************************************************/ 
— #BLOCK_BEGIN# MapAll 



SELECT 



s.iss, 

s.ss_key, 

s.date_key, 

s. transtype_key, 

s.ikey, 

s.process_key 

m_04 ,program_key program_key 

m_03 . application_key application_key 

m_06.territory_key territory_key 

ra_02.product_key productjcey 

m_05 . customer_key customer ship to_key 

m_01 . customer_key customerbillto_key 

m_07 ,warehouse_key warehouse_key 



, s.net_price 
, s . number_units 

INTO OrderStage_MAP 
FROM 

OrderStage s 

ProgramMap_B m_04 (index = 1) 
ApplicationMap_B m__03 (index « 1) 
TerritoryMap_B m_06 (index « 1) 
ProductMap_B m_02 (index « 1) 
CustomerMap_B m_05 (index = 1) 
CustomerMap_B m_01 (index = 1) 
WarehouseMap_B m_07 (index « 1) 



WHERE 1=1 
AND 
AND 
AND 
AND 
AND 
■ AND 
AND 



m_04.iss = s.iss AND m_04 .program_sskey = s .program_sskey 
m_03.iss = s.iss AND m_03 . application_sskey = s . application_sskey 
m_06.iss = s.iss AND m_06. territory_sskey = s . territory_sskey 
m_02.iss = s.iss AND m_02 .product_sskey « s .product_sskey 
m_05.iss = s.iss AND m_05 ^customer_sskey = s . customershipto_sskey 
mJH.iss = s.iss AND m_01 . customer_sskey = s . customerbillto_sskey 
nT07.iss = s.iss AND m_07 . warehouse_sskey = s . warehouse_sskey 



— #BLOCK_END# MapAll 

/******************************+***********************************/ 

— Set join order for SQL Server 

/******************************************************************/ 
— #BLOCK_BEGIN# ForcePlanOff 
SET FORCE PLAN OFF 

— #BLOCK END# ForcePlanOff 
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— #BLOCK BEGINff SPResultS 



DECLARE @unjoined INT 
DECLARE Qprocessed INT 

BEGIN 

SELECT eprocessed = { 
SELECT COUNT ( 1) 

FROM Order Stage 
) 

SELECT 6un joined = ( 

SELECT eprocessed - COUNT (1) 

FROM Order Stage_MAP 
) 

INSERT INTO adaptive_template_prof ile (token_name, number_rows ) 
SELECT ' UNJOINED' , @un joined 

INSERT INTO adaptive_template_prof ile {token_name, number_rows) 
SELECT 'PROCESSED', ©processed 

INSERT INTO adaptive_template_prof ile {token_nante, number_rows) 
SELECT 'INSERTED*, ^processed - @un joined 

END 

— #BLOCK_END# SPResultS 

/★★♦★A**************************************** ************ *********/ 
— Index. this temp table 

/★★A***************************************************************/ 
--#BLOCK_BEGIN# IndexMap 



EXEC ( ' 

CREATE INDEX XOrderStage_MAP ON OrderStage_MAP 
( 

iss, ss_key, date_key, ikey 



— Copyright * 1997, Epiphany Marketing Software, Inc. All Rights Reserved 

— upd_unj 

— Epiphany Marketing Software 

— Update all dimension keys to ' UNKNOWN ' in staging table 

— where referential integrity fails 

y*************** ******************************************************/ 



--#BLOCK_END# IndexMap 



— #TEMPLATE_END# map_keys 
— #TEMPLATE_BEGIN# upd_unj 
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% 



ft 



/******************** *********************************★*******+*******/ " ■ 

— Count the number of rows to update in the staging table - that is, those 

— that have at least one Foreign key where referential integrity fails 
/******************** **************************+**********************/ 

— #BLOCK__BEGIN# CountUnj 
BEGIN 

INSERT INTO adaptive_template_prof ile (token_name, number_rows ) 
SELECT ' PROCESSED' , COUNT(l) FROM OrderStage 

INSERT INTO adapt ive_template_prof ile (token_name, number rows) 

SELECT 'MODIFIED' , COUNT (1) 

FROM 

OrderStage s 
WHERE 1=0 

OR NOT EXISTS (SELECT 1 FROM ProgramMap_B m__04 WHERE m_04.iss = s.iss AND m_0 4 . program sskey 
program_sskey) 

OR NOT EXISTS (SELECT 1 FROM ApplicationMap_B m_03 WHERE m_03.iss = s.iss AND 
m_03 . application_sskey = application_sskey) 

OR NOT EXISTS (SELECT 1 FROM TerritoryMap_B m_06 WHERE m_06.iss « s.iss AND 
m_06.territory_sskey = territory_sskey) 

OR NOT EXISTS (SELECT 1 FROM ProductMap_B m_02 WHERE m_02.iss = s.iss AND m_02. product sskey 
product_sskey) *~ 
OR NOT EXISTS (SELECT 1 FROM CustomerMap_B m_05 WHERE m_05.iss = s.iss AND m_05 . cus tome r__ss key 
= customershipto__sskey) 

OR NOT EXISTS (SELECT 1 FROM CustomerMap_B m_01 WHERE m_01.iss = s.iss AND m_01 . cus tome r_ss key 
= customerbillto_sskey) 

OR NOT EXISTS (SELECT 1 FROM WarehouseMap_B m_07 WHERE m_07.iss « s.iss AND 
m_07 . warehouse_sskey = warehouse_sskey) 

END 

— #BLOCK__END# CountUnj 

/***************** + + + 

— Update foreign keys where referential integrity fails 
/♦★★★★★★★★★a************************************* 

— #BLOCK_BEGIN# UpdateUn jprogram_sskey 

UPDATE OrderStage SET program sskey = ' UNKNOWN ' 
WHERE NOT EXISTS (SELECT 1 FROM ProgramMap_B m 

WHERE m.iss = OrderStage. iss AND m.program_sskey .= OrderStage.program_sskey) 

~#BLOCK_END# UpdateUnjprogram_sskey 

— #BLOCK_BEGIN# UpdateUnj application_sskey . 

UPDATE OrderStage SET application_sskey « 'UNKNOWN' 
WHERE NOT EXISTS (SELECT 1 FROM ApplicationMap_B m 

WHERE m.iss « OrderStage. iss AND m.application_sskey = OrderStage, application's key) 

— #BLOCK_END# UpdateUnj application_sskey 

--#BLOCK_BEGIN# UpdateUnj tefritory_ss key 

UPDATE OrderStage SET territory_sskey « ' UNKNOWN 1 
WHERE NOT EXISTS (SELECT 1 FROM TerritoryMap_B m 

WHERE m.iss » OrderStage. iss AND m. territory_sskey = OrderStage. territory_sskey) 

— #BLOCK_END# UpdateUnj territory_sskey 

— #BLOCK_BEGIN# UpdateUnjproduct_sskey 

UPDATE OrderStage SET product_sskey = 1 UNKNOWN ' 
WHERE NOT EXISTS (SELECT 1 FROM ProductMap_B m 

WHERE m.iss «= OrderStage. iss AND m.product_sskey = OrderStage. product_sskey) 



— #BLOCK END# UpdateUnjproduct sskey 
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— #BLOCK_BEGIN# UpdateUn j customershipto_sskey 

UPDATE OrderStage SET customershipto_sskey = ' UNKNOWN ' 
WHERE NOT EXISTS (SELECT 1 FROM CustomerMap_B m 

WHERE ra.iss= OrderStage . iss AND ra. cus tome r_ss key = OrderStage . customershipto_sskey) 
— #BLOCK_END# UpdateUn jcustomershipto_sskey 



— #BLOCK_BEGIN# UpdateUn jcustomerbi 11 to_ss key 

UPDATE OrderStage SET customerbillto_sskey = ' UNKNOWN ' 
WHERE NOT EXISTS (SELECT 1 FROM CustomerMap_B m 

WHERE ni.iss = OrderStage . iss AND m. cus tome r_ss key = OrderStage. customerbillto_sskey) 

— #BLOCK_END# UpdateUn jcustomerbillto_sskey 

— #BLOCK_BEGIN# UpdateUn jwarehouse_sskey 

UPDATE OrderStage SET warehouse_sskey « ' UNKNOWN 1 
WHERE NOT EXISTS (SELECT 1 FROM WarehouseMap_B m 

WHERE in. iss = OrderStage . iss AND m. warehouse_sskey = OrderStage. warehouse_sskey) 
— #BLOCK_END# UpdateUn j warehouse_sskey 



Note, additional semantic types and adaptive templates can be imported into the system 100. 




— #TEMPLATE_END# upd_unj 
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